-- Logs begin at Wed 2022-07-13 22:58:43 UTC, end at Thu 2022-07-14 00:00:51 UTC. -- Jul 13 23:33:20.742404 dv-osbrick-849759-3-ceph systemd[1]: Starting Devstack devstack@keystone.service... Jul 13 23:33:20.755199 dv-osbrick-849759-3-ceph devstack@keystone.service[98925]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 13 23:33:20.757295 dv-osbrick-849759-3-ceph devstack@keystone.service[98925]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 13 23:33:20 2022] *** Jul 13 23:33:20.757295 dv-osbrick-849759-3-ceph devstack@keystone.service[98925]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 13 23:33:20.757295 dv-osbrick-849759-3-ceph devstack@keystone.service[98925]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 13 23:33:20.757295 dv-osbrick-849759-3-ceph devstack@keystone.service[98925]: nodename: dv-osbrick-849759-3-ceph Jul 13 23:33:20.757295 dv-osbrick-849759-3-ceph devstack@keystone.service[98925]: machine: x86_64 Jul 13 23:33:20.757295 dv-osbrick-849759-3-ceph devstack@keystone.service[98925]: clock source: unix Jul 13 23:33:20.757295 dv-osbrick-849759-3-ceph devstack@keystone.service[98925]: pcre jit disabled Jul 13 23:33:20.757295 dv-osbrick-849759-3-ceph devstack@keystone.service[98925]: detected number of CPU cores: 4 Jul 13 23:33:20.757295 dv-osbrick-849759-3-ceph devstack@keystone.service[98925]: current working directory: / Jul 13 23:33:20.757295 dv-osbrick-849759-3-ceph devstack@keystone.service[98925]: detected binary path: /usr/bin/uwsgi-core Jul 13 23:33:20.757849 dv-osbrick-849759-3-ceph devstack@keystone.service[98925]: your processes number limit is 47680 Jul 13 23:33:20.757849 dv-osbrick-849759-3-ceph devstack@keystone.service[98925]: your memory page size is 4096 bytes Jul 13 23:33:20.757849 dv-osbrick-849759-3-ceph devstack@keystone.service[98925]: detected max file descriptor number: 2048 Jul 13 23:33:20.757849 dv-osbrick-849759-3-ceph devstack@keystone.service[98925]: lock engine: pthread robust mutexes Jul 13 23:33:20.757849 dv-osbrick-849759-3-ceph devstack@keystone.service[98925]: thunder lock: enabled Jul 13 23:33:20.757849 dv-osbrick-849759-3-ceph devstack@keystone.service[98925]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 13 23:33:20.757849 dv-osbrick-849759-3-ceph devstack@keystone.service[98925]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 13 23:33:20.807295 dv-osbrick-849759-3-ceph devstack@keystone.service[98925]: Python main interpreter initialized at 0x560ba2c5c9c0 Jul 13 23:33:20.807295 dv-osbrick-849759-3-ceph devstack@keystone.service[98925]: python threads support enabled Jul 13 23:33:20.807295 dv-osbrick-849759-3-ceph devstack@keystone.service[98925]: your server socket listen backlog is limited to 100 connections Jul 13 23:33:20.807295 dv-osbrick-849759-3-ceph devstack@keystone.service[98925]: your mercy for graceful operations on workers is 90 seconds Jul 13 23:33:20.807590 dv-osbrick-849759-3-ceph devstack@keystone.service[98925]: mapped 403077 bytes (393 KB) for 2 cores Jul 13 23:33:20.807660 dv-osbrick-849759-3-ceph devstack@keystone.service[98925]: *** Operational MODE: preforking *** Jul 13 23:33:20.807909 dv-osbrick-849759-3-ceph devstack@keystone.service[98925]: *** uWSGI is running in multiple interpreter mode *** Jul 13 23:33:20.807909 dv-osbrick-849759-3-ceph devstack@keystone.service[98925]: spawned uWSGI master process (pid: 98925) Jul 13 23:33:20.808098 dv-osbrick-849759-3-ceph systemd[1]: Started Devstack devstack@keystone.service. Jul 13 23:33:20.808848 dv-osbrick-849759-3-ceph devstack@keystone.service[98925]: spawned uWSGI worker 1 (pid: 98935, cores: 1) Jul 13 23:33:20.809861 dv-osbrick-849759-3-ceph devstack@keystone.service[98925]: spawned uWSGI worker 2 (pid: 98936, cores: 1) Jul 13 23:33:20.809861 dv-osbrick-849759-3-ceph devstack@keystone.service[98925]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 13 23:33:26.551316 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 13 23:33:26.551316 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: from cryptography.utils import int_from_bytes Jul 13 23:33:26.551968 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 13 23:33:26.551968 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: from cryptography.utils import int_from_bytes Jul 13 23:33:26.600936 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 13 23:33:26.601119 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 13 23:33:26.601306 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] command line args: [] {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 13 23:33:26.601573 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 13 23:33:26.601747 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ================================================================================ {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 13 23:33:26.601997 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] admin_token = **** {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.602238 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] config_dir = [] {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.602423 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.602603 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] config_source = [] {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.602781 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] debug = True {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.602977 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.604213 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.604213 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] insecure_debug = False {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.604213 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.604213 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.604213 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] list_limit = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.604500 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] log_config_append = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.604564 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.604726 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] log_dir = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.604882 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] log_file = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.605120 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.605366 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.605615 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.605859 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.606036 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.606211 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.606452 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.606693 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.606942 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.607204 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.607437 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.607669 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.607777 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 13 23:33:26.607777 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: from cryptography.utils import int_from_bytes Jul 13 23:33:26.608277 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.608352 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 13 23:33:26.608352 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: from cryptography.utils import int_from_bytes Jul 13 23:33:26.608451 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] notification_format = cadf {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.608451 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.608906 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.609091 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] publish_errors = False {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.609320 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.609547 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.609723 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.609967 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.610200 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.610439 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] standard_threads = False {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.610668 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] strict_password_check = False {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.610908 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.611085 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] use_eventlog = False {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.611261 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] use_journal = False {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.611435 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] use_json = False {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.611608 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] use_stderr = False {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.611783 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] use_syslog = False {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.612015 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] watch_log_file = False {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.612271 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.612507 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.612764 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.613027 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.613275 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.613512 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.613758 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.613995 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.614241 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.614485 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.614731 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.614965 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.615210 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.615446 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.615691 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.615937 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.616172 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.616425 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.616676 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.616941 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.617177 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.617427 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.617686 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.617936 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.618183 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.618413 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.618641 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.618867 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.619101 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.619345 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.619590 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.619817 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.620046 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.620293 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.620538 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.620775 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.621044 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.621273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.621507 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.621740 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.621966 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.622195 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.622421 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.623192 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.623433 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.623679 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.623909 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.624146 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.624372 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.624614 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.624854 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.625100 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.625350 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.625570 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.625797 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.626044 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.626269 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.626507 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.626732 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.626977 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.627210 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.627447 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.627676 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.627931 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.628167 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.628394 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.628630 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.628881 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.629147 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.629380 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.629625 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.629867 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.630102 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.630337 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.630569 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.630821 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] cache.enabled = True {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.631057 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.631291 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.631530 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.631767 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.632003 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.632237 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.632472 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.632704 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.632982 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.633223 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.633460 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.633697 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.633938 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.634175 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.634410 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.634645 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.634872 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.635099 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.635327 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.635560 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.635786 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.636022 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.636257 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.636504 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.636740 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.637016 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.637275 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.637515 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.637744 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] auth.external = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.638910 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] auth.mapped = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.639377 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.639622 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.639857 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] auth.password = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.640093 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] auth.token = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.640335 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.640573 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] catalog.caching = True {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.640860 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.641203 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.641670 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.643095 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.643349 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.643596 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] credential.caching = True {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.643849 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] credential.driver = sql {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.644101 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.644354 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.644595 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.644867 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.645109 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.645377 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.645631 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.645870 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.646123 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.646404 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.646649 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.646909 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.647151 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.647405 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.647641 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] federation.caching = True {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.647877 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.648121 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] federation.driver = sql {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.648364 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.648589 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.648857 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.649087 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.649338 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.649575 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.649828 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.650064 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.650310 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.650543 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] identity.caching = True {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.650788 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.651031 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.651264 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.651502 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.651747 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] identity.driver = sql {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.651977 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.652213 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.652460 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.652711 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.652963 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.653193 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.653421 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.653667 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.654022 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.654290 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.654547 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.654795 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.655065 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.655305 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.655543 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.655775 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.656036 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.656246 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.656482 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.656722 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.656982 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.657231 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.657323 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 13 23:33:26.657461 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 13 23:33:26.657550 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.657668 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] command line args: [] {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 13 23:33:26.657746 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.657934 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.658011 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 13 23:33:26.658113 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ================================================================================ {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 13 23:33:26.658243 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.658369 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] admin_token = **** {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.658447 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.658617 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] config_dir = [] {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.658705 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.658805 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.658900 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.658997 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] config_source = [] {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.659082 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.659184 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] debug = True {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.659285 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.password = **** {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.659398 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.659522 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.659637 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.659758 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.659837 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] insecure_debug = False {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.659997 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.660083 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.660233 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.660312 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.660469 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.660553 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] list_limit = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.660673 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] log_config_append = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.660756 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.660872 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.660952 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.661054 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] log_dir = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.661184 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.661262 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] log_file = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.661418 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.661498 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.661664 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.661742 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.661909 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.661987 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.662144 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.662223 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.662322 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.662405 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.662506 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.662594 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.662753 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.662832 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.user = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.662999 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.663084 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.663233 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.663320 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.663466 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.663546 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.663698 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.663776 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.663930 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.664017 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.664179 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.664265 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.664411 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.664489 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] notification_format = cadf {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.664640 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.664718 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.664903 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.665151 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.665229 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.665374 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] publish_errors = False {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.665462 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.665602 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.665680 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.665828 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.665905 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.666009 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.666101 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.666257 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.666341 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.666490 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.666569 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.666725 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] standard_threads = False {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.666812 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.666959 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] strict_password_check = False {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.667038 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.667202 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.667286 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.667381 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] use_eventlog = False {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.667467 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.667561 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] use_journal = False {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.667665 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.667755 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] use_json = False {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.667878 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.667961 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] use_stderr = False {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.668068 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] use_syslog = False {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.668145 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.668301 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] watch_log_file = False {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 23:33:26.668381 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.668558 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.668643 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.668789 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.668883 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.669060 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] policy.driver = sql {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.669141 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.669290 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.669375 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.669588 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.669669 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.669838 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.670075 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] receipt.caching = True {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.670311 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.670388 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.670555 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.670635 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.670793 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.670874 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.671022 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.671101 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.671257 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.671336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.671502 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] resource.caching = True {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.671583 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.671751 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.671830 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.671996 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] resource.driver = sql {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.672074 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.672229 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.672309 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.672477 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.672554 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.672723 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.672800 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.672981 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] revoke.caching = True {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.673069 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.673224 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.673304 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.673460 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.673539 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.673696 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] role.cache_time = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.673776 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.673932 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] role.caching = True {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.674011 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.674176 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] role.driver = sql {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.674256 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.674403 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] role.list_limit = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.674483 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.674649 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.674728 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.674894 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.674980 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.675131 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.675210 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.675366 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.675445 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.675601 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.675680 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.675841 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.675928 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.676083 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.676161 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.676328 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.676415 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.676555 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.676634 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.676786 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.676887 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.677060 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.677152 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.677310 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.677389 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.677552 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.677630 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.677803 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.678000 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.678082 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.678240 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.678320 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.678487 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.678564 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.678723 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.678804 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.678955 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.679034 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.679189 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.679268 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.679421 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.679501 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.679660 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.679739 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.679910 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.679989 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.680143 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.680223 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.680372 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.680450 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.680603 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.680682 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.680873 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.680958 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.681094 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.681172 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.681346 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.681425 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.681580 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.681661 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.681816 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.681893 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.682049 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.682127 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.682276 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] token.cache_time = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.682357 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.682510 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] token.caching = True {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.682590 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.682744 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.682821 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.682975 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.683055 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] token.provider = fernet {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.683207 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.683290 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.683453 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.683530 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.683690 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.683770 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.683921 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.684008 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.684159 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.684238 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.684433 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.684525 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.684640 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.684719 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] trust.driver = sql {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.684900 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.684982 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.685650 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.685995 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.686082 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.686156 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.686375 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.686460 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.686557 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.686705 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.686784 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.686900 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.687078 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.687157 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.687338 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] database.connection = **** {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.687428 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.687584 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.687666 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.687829 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.687909 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.688067 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.688154 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] cache.enabled = True {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.688307 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.688385 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.688539 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.688617 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.688775 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.688892 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.689032 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.689112 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.689268 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.689347 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.689507 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.689593 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.689749 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.689831 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.689976 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.690054 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.690213 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.690302 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.690457 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.690537 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.690689 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.690769 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.690927 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.691012 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.691151 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.691229 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.691394 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.691473 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.691629 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.691716 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.691790 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=98936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 13 23:33:26.691863 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.692084 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.692316 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.692548 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.692786 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.693043 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.693284 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.693522 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.693773 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.694013 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.694271 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.694530 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.694771 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.695004 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] auth.external = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.695236 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] auth.mapped = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.695532 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.695766 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.695999 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] auth.password = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.696229 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] auth.token = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.696468 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.696705 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] catalog.caching = True {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.696975 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.697208 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.697456 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.697704 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.697936 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.698174 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] credential.caching = True {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.698424 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] credential.driver = sql {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.698681 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.698931 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.699181 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.699426 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.699666 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.699931 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.700188 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.700427 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.701390 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.701824 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.702108 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.702400 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.702670 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.703028 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.703287 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] federation.caching = True {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.703541 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.703803 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] federation.driver = sql {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.704064 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.704305 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.704562 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.704810 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.705099 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.705345 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.705610 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.705854 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.706109 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.706352 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] identity.caching = True {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.706605 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.706857 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.707100 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.707342 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.707594 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] identity.driver = sql {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.707828 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.708069 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.708321 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.708577 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.708810 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.709066 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.709298 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.709547 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.709796 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.710044 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.710299 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.710548 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.710819 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.711059 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.711296 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.711535 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.711772 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.712002 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.712241 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.712484 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.712724 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.712998 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.713229 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.713477 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.713724 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.713960 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.714206 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.714450 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.714680 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.714918 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.715149 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.password = **** {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.715386 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.715621 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.715862 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.716098 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.716349 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.716607 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.716894 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.717129 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.717360 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.717607 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.717856 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.718095 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.718332 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.718570 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.718802 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.user = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.719042 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.719311 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.719541 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.719788 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.720035 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.720280 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.720516 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.720744 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.721005 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.721242 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.721483 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.721711 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.721956 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.722202 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.722447 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.722693 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.722771 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=98936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.722937 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.723018 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=98936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.723168 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.723247 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=98936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.723414 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.723650 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.723883 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.724117 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.724350 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.724595 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.724860 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.725101 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.725356 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] policy.driver = sql {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.725584 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.725830 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.726064 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.726298 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] receipt.caching = True {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.726531 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.726776 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.727016 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.727248 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.727483 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.727725 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] resource.caching = True {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.727974 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.728221 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] resource.driver = sql {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.728457 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.728708 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.728980 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.729229 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] revoke.caching = True {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.729477 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.729714 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.729954 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] role.cache_time = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.730191 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] role.caching = True {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.730440 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] role.driver = sql {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.730671 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] role.list_limit = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.730921 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.731168 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.731420 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.731508 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=98936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.731666 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.731913 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.732158 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.732519 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.732636 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.732891 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.733140 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.733387 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.733631 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.733875 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.734288 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.734525 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.734777 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.735026 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.735275 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.735526 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.735758 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.736014 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.736265 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.736503 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.736735 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.736990 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.737220 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.737472 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.737725 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.737972 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.738209 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.738445 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.738674 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] token.cache_time = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.738911 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] token.caching = True {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.739147 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.739395 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] token.provider = fernet {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.739629 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.739894 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.740142 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.740378 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.740621 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.740885 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.741134 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] trust.driver = sql {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.741378 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.741617 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.741886 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.742132 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.742378 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.742607 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.742849 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.743149 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.743421 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] database.connection = **** {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.743666 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.743913 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.744152 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.744392 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.744628 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.744883 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.745119 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.745355 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.745598 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.745831 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.746071 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.746306 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.746551 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.746785 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.747027 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.747254 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.747492 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.748340 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 23:33:26.748519 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=98935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 13 23:33:26.759929 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=98936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.760156 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=98936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.775294 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=98935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.775527 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=98935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.775755 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=98935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.784900 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=98935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.803390 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=98935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.803571 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=98935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.813712 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=98936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.839737 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=98935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.864529 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=98936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.864767 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=98936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.876642 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=98935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.876900 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=98935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.930121 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.930350 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=98936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.930472 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.930584 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=98936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.930706 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=98935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.930793 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=98936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.930934 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=98935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.931019 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=98936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.931157 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=98935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.931243 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=98936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.931379 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=98935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.931595 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=98935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.954751 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.954989 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=98936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.955129 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.955219 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=98936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.955300 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=98935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.955413 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=98936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.955502 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=98935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.955626 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=98936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.955714 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=98935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.955838 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=98935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.955922 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=98936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.956048 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=98936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.956143 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=98935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.956280 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=98935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.968928 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=98936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.969223 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=98935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.981544 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.981774 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=98936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.982542 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.982666 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=98936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.983182 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=98936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.983251 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=98935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.983345 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=98936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.983424 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=98935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.983499 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=98936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.983573 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=98935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.983647 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=98936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.983722 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=98935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.983722 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=98935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:26.983868 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=98935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 23:33:27.000797 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.001017 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 13 23:33:27.001346 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.001447 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.001528 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 13 23:33:27.001605 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 13 23:33:27.001794 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.001879 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.002048 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.002149 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 13 23:33:27.002300 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.002385 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.002549 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.002633 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.002812 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.003068 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.013865 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.014134 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.014398 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.014482 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.014675 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.014764 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.014949 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.015227 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.022767 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=98936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 23:33:27.023304 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=98935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 23:33:27.026192 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=98936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 23:33:27.026443 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.026717 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.026804 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=98935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 23:33:27.026991 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.027079 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.027266 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.027350 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.027521 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.027605 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.027783 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.027868 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.028038 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.028120 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.028299 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.028390 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.028565 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.028646 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.028873 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.029328 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.029424 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.029424 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.055896 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.056216 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.057485 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=98936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 23:33:27.057763 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.057868 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=98935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 23:33:27.058127 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.063590 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=98936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 23:33:27.063856 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.064001 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=98935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 23:33:27.064130 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.064278 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.064558 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.071506 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=98936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 23:33:27.071783 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.071976 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=98935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 23:33:27.072257 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.076297 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=98936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 23:33:27.076573 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.076865 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.076950 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=98935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 23:33:27.077141 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.077227 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.077407 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.077489 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.077674 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.077766 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.077936 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.078019 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.078197 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.078280 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.078467 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.078731 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.096959 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.097230 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.097606 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.097881 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.101797 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=98936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 23:33:27.102466 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=98935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 23:33:27.105444 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.105735 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.106134 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.106436 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.111231 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=98936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 23:33:27.114852 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=98935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 23:33:27.114968 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=98936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 23:33:27.118580 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=98935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 23:33:27.118689 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.118888 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.119175 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.119450 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.119747 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.120032 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.122252 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.122569 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.123122 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.123224 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.123441 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.123723 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.139875 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=98936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 23:33:27.140156 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.140417 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.140675 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.143789 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=98935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 23:33:27.144076 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.144346 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.144608 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.148545 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.150303 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.150575 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.152492 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.153632 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=98936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 23:33:27.154503 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.154758 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.155031 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.155122 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.155331 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.155613 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.158412 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=98935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 23:33:27.158691 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.158978 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.159260 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.159658 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.168832 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=98936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 23:33:27.169113 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.169387 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.169787 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.170067 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.170335 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.170601 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.173155 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=98935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 23:33:27.173433 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.173709 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.173984 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.174257 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.174527 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.174797 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.188665 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=98936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 23:33:27.191939 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=98936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 23:33:27.193078 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=98935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 23:33:27.195264 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.196324 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=98935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 23:33:27.196887 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.198512 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=98936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 23:33:27.198907 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.199185 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.199663 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.201831 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.203473 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=98935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 23:33:27.203863 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.204143 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.207097 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.208698 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=98936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 23:33:27.211446 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.211923 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.212203 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.212493 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.212763 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.213098 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=98935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 23:33:27.216372 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.217183 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.217462 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.217730 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.223556 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=98936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 23:33:27.223840 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.224115 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.228000 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=98935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 23:33:27.228286 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.228562 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.232127 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=98936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 23:33:27.232410 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.232687 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.232983 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.233262 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.233527 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.233800 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.234059 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.234325 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.234606 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.234977 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.235245 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.235507 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.235763 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=98936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.236595 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=98935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 23:33:27.236893 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.237175 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.237449 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.237720 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.237991 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.238282 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.238552 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.238818 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.239087 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.239453 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.239724 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.239997 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.240264 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=98935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 23:33:27.274524 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x560ba2c5c9c0 pid: 98936 (default app) Jul 13 23:33:27.277927 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3531f0-9571-42f7-b10b-60158719c307 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:27.278222 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3531f0-9571-42f7-b10b-60158719c307 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:27.278500 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3531f0-9571-42f7-b10b-60158719c307 None None] PATH_INFO: `/v3` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:27.279946 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x560ba2c5c9c0 pid: 98935 (default app) Jul 13 23:33:27.282726 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Wed Jul 13 23:33:27 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:33:35.314875 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244be05-6eb9-4574-9410-21809561291c None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:35.315452 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244be05-6eb9-4574-9410-21809561291c None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:35.315452 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244be05-6eb9-4574-9410-21809561291c None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:35.319695 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:33:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:33:35.324878 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a209791-072e-46b9-a46c-3bf61f85c9cb None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:35.325313 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a209791-072e-46b9-a46c-3bf61f85c9cb None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:35.325664 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a209791-072e-46b9-a46c-3bf61f85c9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:35.400627 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: INFO dbcounter [None req-2a209791-072e-46b9-a46c-3bf61f85c9cb None None] Registered counter for database keystone Jul 13 23:33:35.422240 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG oslo_db.sqlalchemy.engines [None req-2a209791-072e-46b9-a46c-3bf61f85c9cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98936) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 23:33:35.431040 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writer thread running {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 13 23:33:35.611436 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG passlib.handlers.bcrypt [None req-2a209791-072e-46b9-a46c-3bf61f85c9cb None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=98936) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 13 23:33:35.611772 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG passlib.handlers.bcrypt [None req-2a209791-072e-46b9-a46c-3bf61f85c9cb None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=98936) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 13 23:33:35.666225 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-2a209791-072e-46b9-a46c-3bf61f85c9cb None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:33:35.667813 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-2a209791-072e-46b9-a46c-3bf61f85c9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:33:35.789213 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:33:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 13 23:33:35.943765 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244be05-6eb9-4574-9410-21809561291c None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:36.019420 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: INFO dbcounter [None req-9244be05-6eb9-4574-9410-21809561291c None None] Registered counter for database keystone Jul 13 23:33:36.038833 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG oslo_db.sqlalchemy.engines [None req-9244be05-6eb9-4574-9410-21809561291c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98935) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 23:33:36.044946 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writer thread running {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 13 23:33:36.162357 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244be05-6eb9-4574-9410-21809561291c None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:36.166632 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5caa857-45e0-44c8-a7df-8238b23e0149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c258143da34685aa94a405e9ab3d07', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:36.167298 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5caa857-45e0-44c8-a7df-8238b23e0149 admin admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:36.167586 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5caa857-45e0-44c8-a7df-8238b23e0149 admin admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:36.167863 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5caa857-45e0-44c8-a7df-8238b23e0149 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:36.176007 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5caa857-45e0-44c8-a7df-8238b23e0149 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:36.227744 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a5caa857-45e0-44c8-a7df-8238b23e0149 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 13 23:33:36.228027 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5caa857-45e0-44c8-a7df-8238b23e0149 admin admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:36.237621 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1324 bytes} [Wed Jul 13 23:33:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 13 23:33:36.243482 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a209791-072e-46b9-a46c-3bf61f85c9cb None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:36.258472 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a209791-072e-46b9-a46c-3bf61f85c9cb None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:36.263763 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04478cd-c1a5-4832-a1c3-0efd20dc34d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c258143da34685aa94a405e9ab3d07', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:36.264910 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04478cd-c1a5-4832-a1c3-0efd20dc34d1 admin admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:36.265202 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04478cd-c1a5-4832-a1c3-0efd20dc34d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:36.265479 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04478cd-c1a5-4832-a1c3-0efd20dc34d1 admin admin] PATH_INFO: `/v3/projects/f6c258143da34685aa94a405e9ab3d07` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:36.266971 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04478cd-c1a5-4832-a1c3-0efd20dc34d1 admin admin] RBAC: Authorizing `identity:get_project(project_id=f6c258143da34685aa94a405e9ab3d07)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:36.319342 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c04478cd-c1a5-4832-a1c3-0efd20dc34d1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 13 23:33:36.319694 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04478cd-c1a5-4832-a1c3-0efd20dc34d1 admin admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:36.324216 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1207 bytes} [Wed Jul 13 23:33:36 2022] GET /identity/v3/projects/f6c258143da34685aa94a405e9ab3d07 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:33:38.536006 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266de26-5b67-48ef-a6c5-ba22b1031793 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:38.536528 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266de26-5b67-48ef-a6c5-ba22b1031793 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:38.536623 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266de26-5b67-48ef-a6c5-ba22b1031793 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:38.540629 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:33:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 23:33:38.546342 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b51227-8d69-4cf2-a381-355ecdbc1267 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:38.546739 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b51227-8d69-4cf2-a381-355ecdbc1267 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:38.546912 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b51227-8d69-4cf2-a381-355ecdbc1267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:38.573166 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-42b51227-8d69-4cf2-a381-355ecdbc1267 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:33:38.574706 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-42b51227-8d69-4cf2-a381-355ecdbc1267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:33:38.583684 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:33:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 13 23:33:38.608966 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266de26-5b67-48ef-a6c5-ba22b1031793 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:38.621116 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266de26-5b67-48ef-a6c5-ba22b1031793 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:38.625958 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c59ff4-d5f1-4fc6-95db-2ace2645529f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c258143da34685aa94a405e9ab3d07', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:38.626592 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c59ff4-d5f1-4fc6-95db-2ace2645529f admin admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:38.626879 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c59ff4-d5f1-4fc6-95db-2ace2645529f admin admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:38.627290 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c59ff4-d5f1-4fc6-95db-2ace2645529f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:38.638964 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c59ff4-d5f1-4fc6-95db-2ace2645529f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:38.640741 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c59ff4-d5f1-4fc6-95db-2ace2645529f admin admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:38.649669 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1324 bytes} [Wed Jul 13 23:33:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 23:33:38.655893 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b51227-8d69-4cf2-a381-355ecdbc1267 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:38.664937 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b51227-8d69-4cf2-a381-355ecdbc1267 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:38.670074 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae00e8a-d221-4723-8ef4-778bf7e8214d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c258143da34685aa94a405e9ab3d07', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:38.670934 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae00e8a-d221-4723-8ef4-778bf7e8214d admin admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:38.671221 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae00e8a-d221-4723-8ef4-778bf7e8214d admin admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:38.671498 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae00e8a-d221-4723-8ef4-778bf7e8214d admin admin] PATH_INFO: `/v3/users/d4a30dab8dc6492bb2bda65abda06d0d` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:38.672922 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae00e8a-d221-4723-8ef4-778bf7e8214d admin admin] RBAC: Authorizing `identity:get_user(user_id=d4a30dab8dc6492bb2bda65abda06d0d)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:38.674757 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae00e8a-d221-4723-8ef4-778bf7e8214d admin admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:38.676313 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1198 bytes} [Wed Jul 13 23:33:38 2022] GET /identity/v3/users/d4a30dab8dc6492bb2bda65abda06d0d => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:33:40.986435 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899608b-93a8-4ede-bac7-662962766359 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:40.986973 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899608b-93a8-4ede-bac7-662962766359 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:40.987056 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899608b-93a8-4ede-bac7-662962766359 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:40.988334 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:33:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:33:40.993445 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7f796-21db-4a91-abd8-04b8141680cd None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:40.993878 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7f796-21db-4a91-abd8-04b8141680cd None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:40.994013 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7f796-21db-4a91-abd8-04b8141680cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:41.007781 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f1f05-d6f5-461b-9592-62d666b8f798 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:41.008066 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f1f05-d6f5-461b-9592-62d666b8f798 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:41.008343 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f1f05-d6f5-461b-9592-62d666b8f798 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:41.009809 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 6/11] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:33:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 23:33:41.011207 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-b6d7f796-21db-4a91-abd8-04b8141680cd None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:33:41.012399 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-b6d7f796-21db-4a91-abd8-04b8141680cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:33:41.015433 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0fe82-8b8e-44e8-8cfa-44291b73e578 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:41.015719 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0fe82-8b8e-44e8-8cfa-44291b73e578 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:41.015997 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0fe82-8b8e-44e8-8cfa-44291b73e578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:41.054388 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG passlib.handlers.bcrypt [None req-24a0fe82-8b8e-44e8-8cfa-44291b73e578 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=98935) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 13 23:33:41.054808 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG passlib.handlers.bcrypt [None req-24a0fe82-8b8e-44e8-8cfa-44291b73e578 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=98935) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 13 23:33:41.096057 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:33:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:33:41.101266 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-24a0fe82-8b8e-44e8-8cfa-44291b73e578 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:33:41.102882 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-24a0fe82-8b8e-44e8-8cfa-44291b73e578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:33:41.120491 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7f796-21db-4a91-abd8-04b8141680cd None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:41.146109 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:33:41.209214 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:33:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 23:33:41.234742 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0fe82-8b8e-44e8-8cfa-44291b73e578 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:41.336011 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0fe82-8b8e-44e8-8cfa-44291b73e578 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:41.336678 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7f796-21db-4a91-abd8-04b8141680cd None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:41.338268 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:33:41.370633 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f30ca4-c99f-485c-b927-0418bb6e0d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:41.371419 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f30ca4-c99f-485c-b927-0418bb6e0d1c None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:41.371704 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f30ca4-c99f-485c-b927-0418bb6e0d1c None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:41.371982 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f30ca4-c99f-485c-b927-0418bb6e0d1c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:41.373918 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd010879-1d68-4288-bfa9-3718efb733b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:41.374813 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd010879-1d68-4288-bfa9-3718efb733b6 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:41.375103 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd010879-1d68-4288-bfa9-3718efb733b6 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:41.375382 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd010879-1d68-4288-bfa9-3718efb733b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:41.382913 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f30ca4-c99f-485c-b927-0418bb6e0d1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:33:41.395135 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-74f30ca4-c99f-485c-b927-0418bb6e0d1c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 23:33:41.395135 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:33:41.395135 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:33:41.395135 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:33:41.395135 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:33:41.395135 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:33:41.395135 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:33:41.395135 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:33:41.395135 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:33:41.395135 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:33:41.395135 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:33:41.395135 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:33:41.395135 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:33:41.395135 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:33:41.395135 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:33:41.395135 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:33:41.396241 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:33:41.396241 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:33:41.396241 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:33:41.396241 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:33:41.396241 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:33:41.396241 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:33:41.396241 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:33:41.396241 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:33:41.396241 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:33:41.396241 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:33:41.396241 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:33:41.396241 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:33:41.396241 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:33:41.396241 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:33:41.396241 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:33:41.396241 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:33:41.397334 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:33:41.397334 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:33:41.397334 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:33:41.397334 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:33:41.397334 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:33:41.397334 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:33:41.397334 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:33:41.397334 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:33:41.397334 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:33:41.397334 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:33:41.397334 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 23:33:41.397334 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:33:41.397334 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 7/14] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 13 23:33:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 23:33:41.402030 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f30ca4-c99f-485c-b927-0418bb6e0d1c None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:41.446357 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd010879-1d68-4288-bfa9-3718efb733b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:41.447880 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd010879-1d68-4288-bfa9-3718efb733b6 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:41.483604 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:33:41.504042 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f30ca4-c99f-485c-b927-0418bb6e0d1c None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:41.542870 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4da8f6-a4a9-4fac-97c2-9112d59c3905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:41.543533 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4da8f6-a4a9-4fac-97c2-9112d59c3905 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:41.543817 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4da8f6-a4a9-4fac-97c2-9112d59c3905 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:41.544195 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4da8f6-a4a9-4fac-97c2-9112d59c3905 None admin] PATH_INFO: `/v3/roles` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:41.544956 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4da8f6-a4a9-4fac-97c2-9112d59c3905 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:33:41.545265 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4da8f6-a4a9-4fac-97c2-9112d59c3905 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:41.546661 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4da8f6-a4a9-4fac-97c2-9112d59c3905 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:41.550185 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 8/15] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 13 23:33:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 13 23:33:41.555686 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd010879-1d68-4288-bfa9-3718efb733b6 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:41.558338 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:33:41.559051 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 8/16] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:33:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:33:41.565206 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4da8f6-a4a9-4fac-97c2-9112d59c3905 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:41.658059 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd010879-1d68-4288-bfa9-3718efb733b6 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:41.664000 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4da8f6-a4a9-4fac-97c2-9112d59c3905 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:41.693934 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a83c3-8504-4e53-a5ad-2a064372c4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:41.694726 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a83c3-8504-4e53-a5ad-2a064372c4a5 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:41.695012 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a83c3-8504-4e53-a5ad-2a064372c4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:41.695284 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a83c3-8504-4e53-a5ad-2a064372c4a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:41.699713 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6f451-dd19-42a0-be4d-7bf2a21828ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:41.700705 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6f451-dd19-42a0-be4d-7bf2a21828ea None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:41.701024 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6f451-dd19-42a0-be4d-7bf2a21828ea None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:41.701305 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6f451-dd19-42a0-be4d-7bf2a21828ea None admin] PATH_INFO: `/v3/users/d4a30dab8dc6492bb2bda65abda06d0d` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:41.702508 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb6f451-dd19-42a0-be4d-7bf2a21828ea None admin] RBAC: Authorizing `identity:get_user(user_id=d4a30dab8dc6492bb2bda65abda06d0d)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:41.703976 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb6f451-dd19-42a0-be4d-7bf2a21828ea None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:41.705629 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 9/17] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 13 23:33:41 2022] GET /identity/v3/users/d4a30dab8dc6492bb2bda65abda06d0d => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:33:41.710938 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6f451-dd19-42a0-be4d-7bf2a21828ea None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:41.713391 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a83c3-8504-4e53-a5ad-2a064372c4a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:41.714849 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a83c3-8504-4e53-a5ad-2a064372c4a5 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:41.727687 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:33:41.737672 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-df5a83c3-8504-4e53-a5ad-2a064372c4a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:33:41.737672 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:33:41.737672 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:33:41.737672 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:33:41.737672 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:33:41.737672 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:33:41.737672 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:33:41.737672 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:33:41.737672 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:33:41.737672 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:33:41.737672 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:33:41.737672 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:33:41.737672 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:33:41.737672 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:33:41.737672 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:33:41.738636 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:33:41.738636 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:33:41.738636 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:33:41.738636 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:33:41.738636 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:33:41.738636 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:33:41.738636 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:33:41.738636 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:33:41.738636 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:33:41.738636 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:33:41.738636 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:33:41.738636 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:33:41.738636 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:33:41.738636 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:33:41.738636 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:33:41.738636 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:33:41.738636 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:33:41.739419 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:33:41.739419 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:33:41.739419 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:33:41.739419 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:33:41.739419 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 9/18] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:33:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 23:33:41.744510 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a83c3-8504-4e53-a5ad-2a064372c4a5 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:41.803230 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:33:41.816985 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6f451-dd19-42a0-be4d-7bf2a21828ea None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:41.852662 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463bf4a-9f47-40e4-856b-223bb823c6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:41.853530 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463bf4a-9f47-40e4-856b-223bb823c6e2 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:41.853816 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463bf4a-9f47-40e4-856b-223bb823c6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:41.854092 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463bf4a-9f47-40e4-856b-223bb823c6e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:41.855338 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c463bf4a-9f47-40e4-856b-223bb823c6e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:41.857415 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c463bf4a-9f47-40e4-856b-223bb823c6e2 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:41.859209 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 10/19] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:33:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:33:41.865430 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463bf4a-9f47-40e4-856b-223bb823c6e2 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:41.950340 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:33:41.953518 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a83c3-8504-4e53-a5ad-2a064372c4a5 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:41.969758 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463bf4a-9f47-40e4-856b-223bb823c6e2 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:41.987214 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7598de1-e5b9-49f7-abdc-7d73926c26b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:41.987871 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7598de1-e5b9-49f7-abdc-7d73926c26b1 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:41.988152 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7598de1-e5b9-49f7-abdc-7d73926c26b1 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:41.988428 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7598de1-e5b9-49f7-abdc-7d73926c26b1 None admin] PATH_INFO: `/v3/domains` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:41.989168 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7598de1-e5b9-49f7-abdc-7d73926c26b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:33:41.989473 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7598de1-e5b9-49f7-abdc-7d73926c26b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:41.990853 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7598de1-e5b9-49f7-abdc-7d73926c26b1 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:42.004114 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376798ac-fb02-498b-9bb6-1634001473f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:42.004769 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376798ac-fb02-498b-9bb6-1634001473f2 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:42.005089 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376798ac-fb02-498b-9bb6-1634001473f2 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:42.005365 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376798ac-fb02-498b-9bb6-1634001473f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:42.006193 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376798ac-fb02-498b-9bb6-1634001473f2 None admin] RBAC: Adding query filter params (role.id=46deff0e06964626a5600c9641454603, scope.domain.id=default, user.id=d4a30dab8dc6492bb2bda65abda06d0d) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:33:42.006506 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376798ac-fb02-498b-9bb6-1634001473f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:42.007927 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376798ac-fb02-498b-9bb6-1634001473f2 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:42.008441 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 10/20] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:33:42.015872 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 11/21] 10.222.0.16 () {56 vars in 1322 bytes} [Wed Jul 13 23:33:41 2022] GET /identity/v3/role_assignments?user.id=d4a30dab8dc6492bb2bda65abda06d0d&scope.domain.id=default&role.id=46deff0e06964626a5600c9641454603 => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:33:44.477585 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34c6fb-7b28-441b-9a50-1cb33d63da33 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:44.478194 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34c6fb-7b28-441b-9a50-1cb33d63da33 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:44.478194 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34c6fb-7b28-441b-9a50-1cb33d63da33 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:44.479486 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 11/22] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:33:44.485056 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92911ef3-c94b-4f6e-a2a1-eba2ea8d120a None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:44.485473 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92911ef3-c94b-4f6e-a2a1-eba2ea8d120a None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:44.485634 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92911ef3-c94b-4f6e-a2a1-eba2ea8d120a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:44.514670 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-92911ef3-c94b-4f6e-a2a1-eba2ea8d120a None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:33:44.515849 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-92911ef3-c94b-4f6e-a2a1-eba2ea8d120a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:33:44.618192 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 12/23] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:33:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:33:44.654062 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34c6fb-7b28-441b-9a50-1cb33d63da33 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:44.732902 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f7f71-d707-4c1a-9a17-ceab41910760 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:44.733075 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f7f71-d707-4c1a-9a17-ceab41910760 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:44.733339 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f7f71-d707-4c1a-9a17-ceab41910760 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:44.734713 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 13/24] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:33:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:33:44.739806 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cdb0c-7c3d-4b85-ab83-cb8e84cc2d67 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:44.740094 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cdb0c-7c3d-4b85-ab83-cb8e84cc2d67 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:44.740378 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cdb0c-7c3d-4b85-ab83-cb8e84cc2d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:44.766433 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-f04cdb0c-7c3d-4b85-ab83-cb8e84cc2d67 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:33:44.767696 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-f04cdb0c-7c3d-4b85-ab83-cb8e84cc2d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:33:44.822800 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34c6fb-7b28-441b-9a50-1cb33d63da33 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:44.860299 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:33:44.895024 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc8c5c-6c52-4989-a4e8-8ae939654a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:44.895833 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc8c5c-6c52-4989-a4e8-8ae939654a8d None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:44.896119 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc8c5c-6c52-4989-a4e8-8ae939654a8d None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:44.896399 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc8c5c-6c52-4989-a4e8-8ae939654a8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:44.918130 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbc8c5c-6c52-4989-a4e8-8ae939654a8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:33:44.926366 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 14/25] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:33:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:33:44.928181 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-9dbc8c5c-6c52-4989-a4e8-8ae939654a8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 23:33:44.928181 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:33:44.928181 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:33:44.928181 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:33:44.928181 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:33:44.928181 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:33:44.928181 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:33:44.928181 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:33:44.928181 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:33:44.928181 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:33:44.928181 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:33:44.928181 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:33:44.928181 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:33:44.928181 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:33:44.928181 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:33:44.928181 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:33:44.929084 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:33:44.929084 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:33:44.929084 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:33:44.929084 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:33:44.929084 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:33:44.929084 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:33:44.929084 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:33:44.929084 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:33:44.929084 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:33:44.929084 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:33:44.929084 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:33:44.929084 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:33:44.929084 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:33:44.929084 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:33:44.929084 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:33:44.929084 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:33:44.929834 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:33:44.929834 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:33:44.929834 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:33:44.929834 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:33:44.929834 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:33:44.929834 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:33:44.929834 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:33:44.929834 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:33:44.929834 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:33:44.929834 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:33:44.929834 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 23:33:44.929834 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:33:44.929834 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 12/26] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 13 23:33:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:33:44.936142 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04cdb0c-7c3d-4b85-ab83-cb8e84cc2d67 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:44.939721 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:33:44.969407 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc8c5c-6c52-4989-a4e8-8ae939654a8d None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:45.083837 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04cdb0c-7c3d-4b85-ab83-cb8e84cc2d67 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:45.136409 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6157f-ec19-4c38-9ca4-7aed0ce8dca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:45.137112 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6157f-ec19-4c38-9ca4-7aed0ce8dca5 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:45.137406 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6157f-ec19-4c38-9ca4-7aed0ce8dca5 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:45.137712 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6157f-ec19-4c38-9ca4-7aed0ce8dca5 None admin] PATH_INFO: `/v3/roles` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:45.138779 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f6157f-ec19-4c38-9ca4-7aed0ce8dca5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:33:45.139164 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f6157f-ec19-4c38-9ca4-7aed0ce8dca5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:45.140592 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f6157f-ec19-4c38-9ca4-7aed0ce8dca5 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:45.166722 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 15/27] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:33:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:33:45.172977 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6157f-ec19-4c38-9ca4-7aed0ce8dca5 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:45.188638 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc8c5c-6c52-4989-a4e8-8ae939654a8d None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:45.255558 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77cd3f3-5a27-4711-904e-8841e5525773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:45.256239 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77cd3f3-5a27-4711-904e-8841e5525773 None admin] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:45.256526 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77cd3f3-5a27-4711-904e-8841e5525773 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:45.256804 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77cd3f3-5a27-4711-904e-8841e5525773 None admin] PATH_INFO: `/v3/roles` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:45.257595 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77cd3f3-5a27-4711-904e-8841e5525773 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:45.258995 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77cd3f3-5a27-4711-904e-8841e5525773 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:45.273236 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:33:45.315805 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6157f-ec19-4c38-9ca4-7aed0ce8dca5 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:45.352857 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5400919-c9c2-4332-9076-e14736a7adaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:45.353696 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5400919-c9c2-4332-9076-e14736a7adaf None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:45.354069 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5400919-c9c2-4332-9076-e14736a7adaf None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:45.354355 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5400919-c9c2-4332-9076-e14736a7adaf None admin] PATH_INFO: `/v3/users/d4a30dab8dc6492bb2bda65abda06d0d` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:45.355594 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5400919-c9c2-4332-9076-e14736a7adaf None admin] RBAC: Authorizing `identity:get_user(user_id=d4a30dab8dc6492bb2bda65abda06d0d)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:45.357782 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5400919-c9c2-4332-9076-e14736a7adaf None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:45.359975 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 16/28] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 13 23:33:45 2022] GET /identity/v3/users/d4a30dab8dc6492bb2bda65abda06d0d => generated 247 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:33:45.361291 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7bafb-59d0-4517-ab41-42d67622d056 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:45.361587 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7bafb-59d0-4517-ab41-42d67622d056 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:45.361901 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7bafb-59d0-4517-ab41-42d67622d056 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:45.363503 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 17/29] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:33:45.368618 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46b71f-009f-4262-a475-01ad3ee0f2cf None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:45.368933 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46b71f-009f-4262-a475-01ad3ee0f2cf None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:45.369216 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46b71f-009f-4262-a475-01ad3ee0f2cf None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:45.370544 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 18/30] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:33:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:33:45.371620 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50990137-c066-40a2-9b6e-c4ad2f1f0779 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:45.372509 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50990137-c066-40a2-9b6e-c4ad2f1f0779 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:45.372749 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50990137-c066-40a2-9b6e-c4ad2f1f0779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:45.392284 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-50990137-c066-40a2-9b6e-c4ad2f1f0779 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:33:45.393653 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-50990137-c066-40a2-9b6e-c4ad2f1f0779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:33:45.437504 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 13/31] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Jul 13 23:33:44 2022] POST /identity/v3/roles => generated 219 bytes in 469 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 23:33:45.438962 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77cd3f3-5a27-4711-904e-8841e5525773 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:45.499837 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 19/32] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:33:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:33:45.504344 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16be34c-245f-4273-bd3f-9ebe61e74b22 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:45.505470 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16be34c-245f-4273-bd3f-9ebe61e74b22 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:45.505754 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16be34c-245f-4273-bd3f-9ebe61e74b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:45.524625 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:33:45.546914 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-e16be34c-245f-4273-bd3f-9ebe61e74b22 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:33:45.548157 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-e16be34c-245f-4273-bd3f-9ebe61e74b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:33:45.651021 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77cd3f3-5a27-4711-904e-8841e5525773 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:45.664723 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:33:45.677915 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 20/33] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:33:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:33:45.679156 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16be34c-245f-4273-bd3f-9ebe61e74b22 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:45.704074 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf60ca-ab92-459f-aed5-159fc5cfc506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:45.704921 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf60ca-ab92-459f-aed5-159fc5cfc506 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:45.705213 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf60ca-ab92-459f-aed5-159fc5cfc506 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:45.705492 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf60ca-ab92-459f-aed5-159fc5cfc506 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:45.707760 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cf60ca-ab92-459f-aed5-159fc5cfc506 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:45.709364 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cf60ca-ab92-459f-aed5-159fc5cfc506 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:45.712105 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 14/34] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:33:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:33:45.714198 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf60ca-ab92-459f-aed5-159fc5cfc506 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:45.829663 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16be34c-245f-4273-bd3f-9ebe61e74b22 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:45.857842 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf60ca-ab92-459f-aed5-159fc5cfc506 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:45.861712 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:33:45.882494 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631498d-87a7-493e-ab6e-415e57bba69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:45.883140 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631498d-87a7-493e-ab6e-415e57bba69e None admin] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:45.883494 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631498d-87a7-493e-ab6e-415e57bba69e None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:45.883781 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631498d-87a7-493e-ab6e-415e57bba69e None admin] PATH_INFO: `/v3/roles` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:45.884589 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1631498d-87a7-493e-ab6e-415e57bba69e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:45.886295 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1631498d-87a7-493e-ab6e-415e57bba69e None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:45.905453 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b3336-d60b-4101-ba24-ee43311c3634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:45.906623 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b3336-d60b-4101-ba24-ee43311c3634 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:45.907104 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b3336-d60b-4101-ba24-ee43311c3634 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:45.907637 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b3336-d60b-4101-ba24-ee43311c3634 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:45.920575 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b3336-d60b-4101-ba24-ee43311c3634 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:45.922471 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b3336-d60b-4101-ba24-ee43311c3634 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:45.942757 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-8a0b3336-d60b-4101-ba24-ee43311c3634 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:33:45.942757 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:33:45.942757 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:33:45.942757 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:33:45.942757 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:33:45.942757 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:33:45.942757 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:33:45.942757 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:33:45.942757 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:33:45.942757 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:33:45.942757 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:33:45.942757 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:33:45.942757 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:33:45.942757 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:33:45.942757 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:33:45.943627 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:33:45.943627 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:33:45.943627 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:33:45.943627 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:33:45.943627 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:33:45.943627 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:33:45.943627 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:33:45.943627 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:33:45.943627 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:33:45.943627 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:33:45.943627 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:33:45.943627 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:33:45.943627 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:33:45.943627 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:33:45.943627 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:33:45.943627 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:33:45.943627 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:33:45.944430 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:33:45.944430 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:33:45.944430 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:33:45.944430 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:33:45.946412 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 15/35] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:33:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 23:33:45.947461 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b3336-d60b-4101-ba24-ee43311c3634 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:46.047868 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 21/36] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Jul 13 23:33:45 2022] POST /identity/v3/roles => generated 225 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 23:33:46.049423 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631498d-87a7-493e-ab6e-415e57bba69e None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:46.069084 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b3336-d60b-4101-ba24-ee43311c3634 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:46.113318 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:33:46.117892 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5e603-f615-446d-9db3-1fe35f43d7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:46.118797 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5e603-f615-446d-9db3-1fe35f43d7b4 None admin] REQUEST_METHOD: `PUT` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:46.119086 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5e603-f615-446d-9db3-1fe35f43d7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:46.119370 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5e603-f615-446d-9db3-1fe35f43d7b4 None admin] PATH_INFO: `/v3/domains/default/users/d4a30dab8dc6492bb2bda65abda06d0d/roles/46deff0e06964626a5600c9641454603` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:46.122865 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d5e603-f615-446d-9db3-1fe35f43d7b4 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=d4a30dab8dc6492bb2bda65abda06d0d, role_id=46deff0e06964626a5600c9641454603)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:46.124488 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d5e603-f615-446d-9db3-1fe35f43d7b4 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:46.145330 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 16/37] 10.222.0.16 () {58 vars in 1361 bytes} [Wed Jul 13 23:33:45 2022] PUT /identity/v3/domains/default/users/d4a30dab8dc6492bb2bda65abda06d0d/roles/46deff0e06964626a5600c9641454603 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 23:33:46.183127 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631498d-87a7-493e-ab6e-415e57bba69e None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:46.228455 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ebd60-7bd8-4083-918c-bee5ad712c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:46.229553 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ebd60-7bd8-4083-918c-bee5ad712c99 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:46.230101 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ebd60-7bd8-4083-918c-bee5ad712c99 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:46.230644 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ebd60-7bd8-4083-918c-bee5ad712c99 None admin] PATH_INFO: `/v3/domains` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:46.232388 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ebd60-7bd8-4083-918c-bee5ad712c99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:33:46.233043 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ebd60-7bd8-4083-918c-bee5ad712c99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:46.234896 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ebd60-7bd8-4083-918c-bee5ad712c99 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:46.258237 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 22/38] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:33:46.264474 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5e603-f615-446d-9db3-1fe35f43d7b4 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:46.301428 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:33:46.347993 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1dda3-204b-4da4-9e8c-d5608fbd8d94 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:46.348787 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1dda3-204b-4da4-9e8c-d5608fbd8d94 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:46.349410 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1dda3-204b-4da4-9e8c-d5608fbd8d94 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:46.351250 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 23/39] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:33:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 23:33:46.364876 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280d73e-99f9-413b-bf50-cff2f9cbbbb1 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:46.365499 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280d73e-99f9-413b-bf50-cff2f9cbbbb1 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:46.366004 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280d73e-99f9-413b-bf50-cff2f9cbbbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:46.390086 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-7280d73e-99f9-413b-bf50-cff2f9cbbbb1 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:33:46.392088 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-7280d73e-99f9-413b-bf50-cff2f9cbbbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:33:46.415624 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5e603-f615-446d-9db3-1fe35f43d7b4 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:46.470919 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0cc73b-cd2a-4de0-9020-135bbefb7094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:46.472065 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cc73b-cd2a-4de0-9020-135bbefb7094 None admin] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:46.472558 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cc73b-cd2a-4de0-9020-135bbefb7094 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:46.473188 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cc73b-cd2a-4de0-9020-135bbefb7094 None admin] PATH_INFO: `/v3/projects` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:46.474160 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0cc73b-cd2a-4de0-9020-135bbefb7094 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:46.476031 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0cc73b-cd2a-4de0-9020-135bbefb7094 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:46.483407 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 24/40] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:33:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 23:33:46.514495 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 17/41] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jul 13 23:33:46 2022] POST /identity/v3/projects => generated 301 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 23:33:46.514823 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7280d73e-99f9-413b-bf50-cff2f9cbbbb1 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:46.581217 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:33:46.643609 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7280d73e-99f9-413b-bf50-cff2f9cbbbb1 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:46.676667 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485b747-e61b-4763-a717-578a5dfa9942 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:46.677675 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485b747-e61b-4763-a717-578a5dfa9942 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:46.678153 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485b747-e61b-4763-a717-578a5dfa9942 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:46.679771 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 18/42] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:33:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 23:33:46.686442 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375bc05-6cea-48e1-84da-cafef984f5b6 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:46.687118 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375bc05-6cea-48e1-84da-cafef984f5b6 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:46.687707 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375bc05-6cea-48e1-84da-cafef984f5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:46.690401 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a02b6-bddb-4692-bda6-6783b0c648b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:46.691235 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a02b6-bddb-4692-bda6-6783b0c648b1 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:46.691529 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a02b6-bddb-4692-bda6-6783b0c648b1 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:46.691814 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a02b6-bddb-4692-bda6-6783b0c648b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:46.693119 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a02b6-bddb-4692-bda6-6783b0c648b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:46.694645 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a02b6-bddb-4692-bda6-6783b0c648b1 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:46.696630 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 25/43] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:33:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:33:46.702963 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a02b6-bddb-4692-bda6-6783b0c648b1 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:46.710273 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-f375bc05-6cea-48e1-84da-cafef984f5b6 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:33:46.712078 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-f375bc05-6cea-48e1-84da-cafef984f5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:33:46.781154 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:33:46.788980 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 19/44] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:33:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 23:33:46.812969 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375bc05-6cea-48e1-84da-cafef984f5b6 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:46.815542 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a02b6-bddb-4692-bda6-6783b0c648b1 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:46.832278 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:33:46.857090 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8515c10-840e-4345-9706-4cbd986e3242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:46.857752 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8515c10-840e-4345-9706-4cbd986e3242 None admin] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:46.858039 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8515c10-840e-4345-9706-4cbd986e3242 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:46.858501 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8515c10-840e-4345-9706-4cbd986e3242 None admin] PATH_INFO: `/v3/projects` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:46.859047 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8515c10-840e-4345-9706-4cbd986e3242 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:46.860498 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8515c10-840e-4345-9706-4cbd986e3242 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:46.890927 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 26/45] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jul 13 23:33:46 2022] POST /identity/v3/projects => generated 312 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 23:33:46.925499 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375bc05-6cea-48e1-84da-cafef984f5b6 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:46.963561 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7aee99-01b5-4263-9feb-4d8a12a561d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:46.964253 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7aee99-01b5-4263-9feb-4d8a12a561d4 None admin] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:46.964538 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7aee99-01b5-4263-9feb-4d8a12a561d4 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:46.964815 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7aee99-01b5-4263-9feb-4d8a12a561d4 None admin] PATH_INFO: `/v3/roles` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:46.965611 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7aee99-01b5-4263-9feb-4d8a12a561d4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:46.967727 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7aee99-01b5-4263-9feb-4d8a12a561d4 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:46.982507 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 20/46] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Jul 13 23:33:46 2022] POST /identity/v3/roles => generated 223 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 23:33:48.547487 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d8009-89da-4fcb-93ae-faed4c9376fe None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:48.547898 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d8009-89da-4fcb-93ae-faed4c9376fe None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:48.548066 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d8009-89da-4fcb-93ae-faed4c9376fe None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:48.549466 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 27/47] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:33:48.554697 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3933ab4-69d8-457b-9d02-987c7a2fcd4e None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:48.555113 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3933ab4-69d8-457b-9d02-987c7a2fcd4e None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:48.555270 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3933ab4-69d8-457b-9d02-987c7a2fcd4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:48.572262 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-b3933ab4-69d8-457b-9d02-987c7a2fcd4e None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:33:48.573492 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-b3933ab4-69d8-457b-9d02-987c7a2fcd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:33:48.626094 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:33:48.642385 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 21/48] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:33:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:33:48.666864 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d8009-89da-4fcb-93ae-faed4c9376fe None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:48.769172 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d8009-89da-4fcb-93ae-faed4c9376fe None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:48.802714 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b2cbf-35a0-4d6c-9e6b-a9da4975b030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:48.803434 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b2cbf-35a0-4d6c-9e6b-a9da4975b030 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:48.803722 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b2cbf-35a0-4d6c-9e6b-a9da4975b030 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:48.804003 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b2cbf-35a0-4d6c-9e6b-a9da4975b030 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:48.814053 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407b2cbf-35a0-4d6c-9e6b-a9da4975b030 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:33:48.822630 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-407b2cbf-35a0-4d6c-9e6b-a9da4975b030 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 23:33:48.822630 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:33:48.822630 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:33:48.822630 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:33:48.822630 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:33:48.822630 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:33:48.822630 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:33:48.822630 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:33:48.822630 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:33:48.822630 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:33:48.822630 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:33:48.822630 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:33:48.822630 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:33:48.822630 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:33:48.822630 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:33:48.822630 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:33:48.823426 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:33:48.823426 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:33:48.823426 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:33:48.823426 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:33:48.823426 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:33:48.823426 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:33:48.823426 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:33:48.823426 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:33:48.823426 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:33:48.823426 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:33:48.823426 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:33:48.823426 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:33:48.823426 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:33:48.823426 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:33:48.823426 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:33:48.823426 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:33:48.824165 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:33:48.824165 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:33:48.824165 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:33:48.824165 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:33:48.824165 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:33:48.824165 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:33:48.824165 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:33:48.824165 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:33:48.824165 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:33:48.824165 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:33:48.824165 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 23:33:48.824165 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:33:48.825682 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 28/49] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 13 23:33:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:33:48.830365 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3933ab4-69d8-457b-9d02-987c7a2fcd4e None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:48.932166 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3933ab4-69d8-457b-9d02-987c7a2fcd4e None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:48.967028 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c53ec-844d-4985-a545-96752ff80791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:48.967796 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c53ec-844d-4985-a545-96752ff80791 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:48.968129 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c53ec-844d-4985-a545-96752ff80791 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:48.968586 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c53ec-844d-4985-a545-96752ff80791 None admin] PATH_INFO: `/v3/roles` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:48.969962 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c53ec-844d-4985-a545-96752ff80791 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:33:48.970524 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c53ec-844d-4985-a545-96752ff80791 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:48.973032 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c53ec-844d-4985-a545-96752ff80791 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:48.987059 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 22/50] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:33:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:33:48.992904 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b2cbf-35a0-4d6c-9e6b-a9da4975b030 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:49.021786 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:33:49.097053 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b2cbf-35a0-4d6c-9e6b-a9da4975b030 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:49.129676 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad42a4-03cf-4a62-bb77-6e57b47d28bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:49.130544 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad42a4-03cf-4a62-bb77-6e57b47d28bf None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:49.130830 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad42a4-03cf-4a62-bb77-6e57b47d28bf None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:49.131108 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad42a4-03cf-4a62-bb77-6e57b47d28bf None admin] PATH_INFO: `/v3/users/d4a30dab8dc6492bb2bda65abda06d0d` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:49.132286 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad42a4-03cf-4a62-bb77-6e57b47d28bf None admin] RBAC: Authorizing `identity:get_user(user_id=d4a30dab8dc6492bb2bda65abda06d0d)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:49.133778 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad42a4-03cf-4a62-bb77-6e57b47d28bf None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:49.135393 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 29/51] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 13 23:33:48 2022] GET /identity/v3/users/d4a30dab8dc6492bb2bda65abda06d0d => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:33:49.141292 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c53ec-844d-4985-a545-96752ff80791 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:49.152798 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8243a9-35fc-4f1b-9aca-0b7ef904cb7e None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:49.153635 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8243a9-35fc-4f1b-9aca-0b7ef904cb7e None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:49.153937 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8243a9-35fc-4f1b-9aca-0b7ef904cb7e None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:49.155443 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 30/52] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:33:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 23:33:49.160998 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d054f-5e47-4348-9f28-b55a3d4c4d57 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:49.161364 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d054f-5e47-4348-9f28-b55a3d4c4d57 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:49.161835 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d054f-5e47-4348-9f28-b55a3d4c4d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:49.179769 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-238d054f-5e47-4348-9f28-b55a3d4c4d57 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:33:49.181120 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-238d054f-5e47-4348-9f28-b55a3d4c4d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:33:49.195095 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:33:49.244775 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c53ec-844d-4985-a545-96752ff80791 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:49.245160 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 31/53] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:33:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:33:49.269748 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d054f-5e47-4348-9f28-b55a3d4c4d57 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:49.278589 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce892fdf-b4f7-4e79-8b21-cab6b1e4c650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:49.279386 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce892fdf-b4f7-4e79-8b21-cab6b1e4c650 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:49.279676 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce892fdf-b4f7-4e79-8b21-cab6b1e4c650 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:49.279954 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce892fdf-b4f7-4e79-8b21-cab6b1e4c650 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:49.281170 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce892fdf-b4f7-4e79-8b21-cab6b1e4c650 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:49.282624 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce892fdf-b4f7-4e79-8b21-cab6b1e4c650 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:49.284230 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 23/54] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:33:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:33:49.290172 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce892fdf-b4f7-4e79-8b21-cab6b1e4c650 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:49.293111 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:33:49.369044 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d054f-5e47-4348-9f28-b55a3d4c4d57 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:49.390614 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce892fdf-b4f7-4e79-8b21-cab6b1e4c650 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:49.402262 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273cb0e1-1f1e-4f57-b164-3020a0b02fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:49.403315 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273cb0e1-1f1e-4f57-b164-3020a0b02fbc None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:49.403656 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273cb0e1-1f1e-4f57-b164-3020a0b02fbc None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:49.403938 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273cb0e1-1f1e-4f57-b164-3020a0b02fbc None admin] PATH_INFO: `/v3/domains/default` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:49.405125 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273cb0e1-1f1e-4f57-b164-3020a0b02fbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:49.406581 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273cb0e1-1f1e-4f57-b164-3020a0b02fbc None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:49.406980 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:33:49.408261 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 32/55] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:33:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:33:49.413888 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273cb0e1-1f1e-4f57-b164-3020a0b02fbc None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:49.424520 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccab370-5970-4a5c-b92b-652296fcf7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:49.425523 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccab370-5970-4a5c-b92b-652296fcf7bd None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:49.425814 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccab370-5970-4a5c-b92b-652296fcf7bd None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:49.426098 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccab370-5970-4a5c-b92b-652296fcf7bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:49.426951 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccab370-5970-4a5c-b92b-652296fcf7bd None admin] RBAC: Adding query filter params (role.id=46deff0e06964626a5600c9641454603, scope.domain.id=default, user.id=d4a30dab8dc6492bb2bda65abda06d0d) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:33:49.427267 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccab370-5970-4a5c-b92b-652296fcf7bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:49.428692 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccab370-5970-4a5c-b92b-652296fcf7bd None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:49.437387 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 24/56] 10.222.0.16 () {56 vars in 1322 bytes} [Wed Jul 13 23:33:49 2022] GET /identity/v3/role_assignments?user.id=d4a30dab8dc6492bb2bda65abda06d0d&scope.domain.id=default&role.id=46deff0e06964626a5600c9641454603 => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:33:49.508808 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:33:49.519951 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273cb0e1-1f1e-4f57-b164-3020a0b02fbc None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:49.558328 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923dff9-d7d7-4335-94c7-4edb1b98d965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:49.559010 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923dff9-d7d7-4335-94c7-4edb1b98d965 None admin] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:49.559320 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923dff9-d7d7-4335-94c7-4edb1b98d965 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:49.560189 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923dff9-d7d7-4335-94c7-4edb1b98d965 None admin] PATH_INFO: `/v3/projects` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:49.560964 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923dff9-d7d7-4335-94c7-4edb1b98d965 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:49.562456 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923dff9-d7d7-4335-94c7-4edb1b98d965 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:49.589057 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 33/57] 10.222.0.16 () {60 vars in 1140 bytes} [Wed Jul 13 23:33:49 2022] POST /identity/v3/projects => generated 298 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 23:33:51.826628 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d01e6a-1226-4e99-a17e-59fd1ed2981e None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:51.827140 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d01e6a-1226-4e99-a17e-59fd1ed2981e None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:51.827140 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d01e6a-1226-4e99-a17e-59fd1ed2981e None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:51.828476 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 25/58] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:33:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:33:51.833632 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90a063-51b6-4ae3-9412-e57dd259b796 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:51.834028 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90a063-51b6-4ae3-9412-e57dd259b796 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:51.834197 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90a063-51b6-4ae3-9412-e57dd259b796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:51.851588 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-7b90a063-51b6-4ae3-9412-e57dd259b796 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:33:51.852758 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-7b90a063-51b6-4ae3-9412-e57dd259b796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:33:51.916794 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 34/59] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:33:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:33:51.943532 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d01e6a-1226-4e99-a17e-59fd1ed2981e None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:52.043905 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d01e6a-1226-4e99-a17e-59fd1ed2981e None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:52.077412 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc834d7-ec68-4033-8b54-dda729a80a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:52.078130 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc834d7-ec68-4033-8b54-dda729a80a62 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:52.078417 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc834d7-ec68-4033-8b54-dda729a80a62 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:52.078688 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc834d7-ec68-4033-8b54-dda729a80a62 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:52.079840 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc834d7-ec68-4033-8b54-dda729a80a62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:52.081289 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc834d7-ec68-4033-8b54-dda729a80a62 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:52.082861 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 26/60] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:33:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:33:52.088301 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90a063-51b6-4ae3-9412-e57dd259b796 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:52.155319 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:33:52.185860 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90a063-51b6-4ae3-9412-e57dd259b796 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:52.217997 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571d67d-bf0a-402f-8639-91dc3f6cc919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:52.218649 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571d67d-bf0a-402f-8639-91dc3f6cc919 None admin] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:52.218935 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571d67d-bf0a-402f-8639-91dc3f6cc919 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:52.219210 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571d67d-bf0a-402f-8639-91dc3f6cc919 None admin] PATH_INFO: `/v3/users` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:52.219918 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571d67d-bf0a-402f-8639-91dc3f6cc919 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:52.221402 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571d67d-bf0a-402f-8639-91dc3f6cc919 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:52.246083 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 35/61] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jul 13 23:33:52 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 23:33:55.663989 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c96c2-7ec6-4571-a576-65e4533209b2 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:55.663989 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c96c2-7ec6-4571-a576-65e4533209b2 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:55.663989 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c96c2-7ec6-4571-a576-65e4533209b2 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:55.663989 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 27/62] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:33:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:33:55.669904 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409baf7-c30d-48f4-a3fd-d305d3fbc5f1 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:55.670792 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409baf7-c30d-48f4-a3fd-d305d3fbc5f1 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:55.671275 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409baf7-c30d-48f4-a3fd-d305d3fbc5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:55.693846 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-b409baf7-c30d-48f4-a3fd-d305d3fbc5f1 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:33:55.695377 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-b409baf7-c30d-48f4-a3fd-d305d3fbc5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:33:55.702782 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dcbb18-4b92-4579-b560-241503830c12 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:55.703337 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dcbb18-4b92-4579-b560-241503830c12 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:55.703830 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dcbb18-4b92-4579-b560-241503830c12 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:55.705416 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 28/63] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:33:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 23:33:55.710401 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91696b0c-d610-4650-beab-5da4c1a1c485 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:55.710965 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91696b0c-d610-4650-beab-5da4c1a1c485 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:55.711445 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91696b0c-d610-4650-beab-5da4c1a1c485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:55.729236 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-91696b0c-d610-4650-beab-5da4c1a1c485 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:33:55.730741 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-91696b0c-d610-4650-beab-5da4c1a1c485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:33:55.787574 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:33:55.821186 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 29/64] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:33:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 23:33:55.826006 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 36/65] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:33:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:33:55.871452 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91696b0c-d610-4650-beab-5da4c1a1c485 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:55.874106 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409baf7-c30d-48f4-a3fd-d305d3fbc5f1 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:55.954899 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:33:56.003794 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409baf7-c30d-48f4-a3fd-d305d3fbc5f1 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:56.023361 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91696b0c-d610-4650-beab-5da4c1a1c485 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:56.042220 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c180f-04ff-4d1a-a70b-ddfa68701cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:56.044772 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c180f-04ff-4d1a-a70b-ddfa68701cf9 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:56.045260 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c180f-04ff-4d1a-a70b-ddfa68701cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:56.045734 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c180f-04ff-4d1a-a70b-ddfa68701cf9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:56.057039 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c180f-04ff-4d1a-a70b-ddfa68701cf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:33:56.064613 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cdd244-4f3f-41c8-8354-3240b7988bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:56.065442 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cdd244-4f3f-41c8-8354-3240b7988bee None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:56.065730 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cdd244-4f3f-41c8-8354-3240b7988bee None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:56.066007 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cdd244-4f3f-41c8-8354-3240b7988bee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:56.066476 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-561c180f-04ff-4d1a-a70b-ddfa68701cf9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 23:33:56.066476 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:33:56.066476 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:33:56.066476 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:33:56.066476 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:33:56.066476 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:33:56.066476 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:33:56.066476 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:33:56.066476 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:33:56.066476 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:33:56.066476 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:33:56.066476 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:33:56.066476 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:33:56.066476 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:33:56.066476 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:33:56.066476 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:33:56.067265 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:33:56.067265 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:33:56.067265 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:33:56.067265 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:33:56.067265 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:33:56.067265 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:33:56.067265 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:33:56.067265 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:33:56.067265 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:33:56.067265 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:33:56.067265 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:33:56.067265 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:33:56.067265 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:33:56.067265 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:33:56.067265 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:33:56.067265 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:33:56.068000 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:33:56.068000 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:33:56.068000 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:33:56.068000 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:33:56.068000 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:33:56.068000 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:33:56.068000 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:33:56.068000 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:33:56.068000 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:33:56.068000 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:33:56.068000 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 23:33:56.068000 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:33:56.070328 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 37/66] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:33:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 23:33:56.071992 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84deb04-6201-49de-a118-92cb89f89384 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:56.072477 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84deb04-6201-49de-a118-92cb89f89384 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:56.072977 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84deb04-6201-49de-a118-92cb89f89384 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:56.074442 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 38/67] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:33:56.076874 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84deb04-6201-49de-a118-92cb89f89384 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:56.076983 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cdd244-4f3f-41c8-8354-3240b7988bee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:33:56.085862 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-97cdd244-4f3f-41c8-8354-3240b7988bee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 23:33:56.085862 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:33:56.085862 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:33:56.085862 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:33:56.085862 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:33:56.085862 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:33:56.085862 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:33:56.085862 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:33:56.085862 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:33:56.085862 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:33:56.085862 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:33:56.085862 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:33:56.085862 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:33:56.085862 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:33:56.085862 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:33:56.085862 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:33:56.086721 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:33:56.086721 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:33:56.086721 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:33:56.086721 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:33:56.086721 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:33:56.086721 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:33:56.086721 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:33:56.086721 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:33:56.086721 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:33:56.086721 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:33:56.086721 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:33:56.086721 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:33:56.086721 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:33:56.086721 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:33:56.086721 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:33:56.086721 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:33:56.087868 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:33:56.087868 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:33:56.087868 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:33:56.087868 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:33:56.087868 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:33:56.087868 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:33:56.087868 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:33:56.087868 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:33:56.087868 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:33:56.087868 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:33:56.087868 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 23:33:56.087868 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:33:56.087868 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 30/68] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 13 23:33:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:33:56.088725 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd10162-d8b4-46ea-a3c9-d5fdcd7fd21b None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:56.088725 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd10162-d8b4-46ea-a3c9-d5fdcd7fd21b None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:56.088874 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd10162-d8b4-46ea-a3c9-d5fdcd7fd21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:56.110309 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-fcd10162-d8b4-46ea-a3c9-d5fdcd7fd21b None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:33:56.111680 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-fcd10162-d8b4-46ea-a3c9-d5fdcd7fd21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:33:56.159202 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:33:56.202763 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84deb04-6201-49de-a118-92cb89f89384 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:56.208502 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 31/69] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:33:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:33:56.209177 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd10162-d8b4-46ea-a3c9-d5fdcd7fd21b None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:56.225088 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:33:56.244761 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10b7c6-7800-460a-9459-e3bba2cec9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:56.245859 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10b7c6-7800-460a-9459-e3bba2cec9e0 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:56.246349 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10b7c6-7800-460a-9459-e3bba2cec9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:56.248194 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10b7c6-7800-460a-9459-e3bba2cec9e0 None admin] PATH_INFO: `/v3/roles` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:56.249331 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd10b7c6-7800-460a-9459-e3bba2cec9e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:33:56.249871 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd10b7c6-7800-460a-9459-e3bba2cec9e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:56.251552 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd10b7c6-7800-460a-9459-e3bba2cec9e0 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:56.261986 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 39/70] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 13 23:33:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:33:56.264546 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10b7c6-7800-460a-9459-e3bba2cec9e0 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:56.319854 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd10162-d8b4-46ea-a3c9-d5fdcd7fd21b None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:56.357796 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b64d9-1a15-4668-ab9e-476fadad5074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:56.359082 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b64d9-1a15-4668-ab9e-476fadad5074 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:56.359542 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b64d9-1a15-4668-ab9e-476fadad5074 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:56.359986 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b64d9-1a15-4668-ab9e-476fadad5074 None admin] PATH_INFO: `/v3/roles` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:56.360918 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b64d9-1a15-4668-ab9e-476fadad5074 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:33:56.361802 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b64d9-1a15-4668-ab9e-476fadad5074 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:56.363806 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b64d9-1a15-4668-ab9e-476fadad5074 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:56.373636 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10b7c6-7800-460a-9459-e3bba2cec9e0 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:56.374990 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 32/71] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:33:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:33:56.377028 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b64d9-1a15-4668-ab9e-476fadad5074 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:56.411515 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f448dc2f-dd89-4d31-bf8f-af4f892cfb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:56.412327 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448dc2f-dd89-4d31-bf8f-af4f892cfb33 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:56.412616 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448dc2f-dd89-4d31-bf8f-af4f892cfb33 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:56.412930 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448dc2f-dd89-4d31-bf8f-af4f892cfb33 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:56.415643 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:33:56.423512 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f448dc2f-dd89-4d31-bf8f-af4f892cfb33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:33:56.431691 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-f448dc2f-dd89-4d31-bf8f-af4f892cfb33 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 23:33:56.431691 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:33:56.431691 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:33:56.431691 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:33:56.431691 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:33:56.431691 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:33:56.431691 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:33:56.431691 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:33:56.431691 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:33:56.431691 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:33:56.431691 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:33:56.431691 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:33:56.431691 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:33:56.431691 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:33:56.431691 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:33:56.431691 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:33:56.432517 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:33:56.432517 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:33:56.432517 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:33:56.432517 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:33:56.432517 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:33:56.432517 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:33:56.432517 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:33:56.432517 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:33:56.432517 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:33:56.432517 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:33:56.432517 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:33:56.432517 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:33:56.432517 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:33:56.432517 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:33:56.432517 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:33:56.432517 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:33:56.433706 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:33:56.433706 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:33:56.433706 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:33:56.433706 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:33:56.433706 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:33:56.433706 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:33:56.433706 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:33:56.433706 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:33:56.433706 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:33:56.433706 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:33:56.433706 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 23:33:56.433706 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:33:56.433706 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 40/72] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jul 13 23:33:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:33:56.434911 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034288a-ddb5-42e6-9782-e526e3f12730 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:56.434911 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034288a-ddb5-42e6-9782-e526e3f12730 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:56.434911 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034288a-ddb5-42e6-9782-e526e3f12730 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:56.436219 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 41/73] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:33:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:33:56.436709 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034288a-ddb5-42e6-9782-e526e3f12730 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:56.480957 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:33:56.488953 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b64d9-1a15-4668-ab9e-476fadad5074 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:56.533443 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c5ef6-3b67-42bb-81b2-e2b1166031aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:56.534320 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c5ef6-3b67-42bb-81b2-e2b1166031aa None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:56.534602 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c5ef6-3b67-42bb-81b2-e2b1166031aa None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:56.534877 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c5ef6-3b67-42bb-81b2-e2b1166031aa None admin] PATH_INFO: `/v3/users/1db35c40e944463587194d432aaf15bb` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:56.545436 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034288a-ddb5-42e6-9782-e526e3f12730 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:56.551850 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c5ef6-3b67-42bb-81b2-e2b1166031aa None admin] RBAC: Authorizing `identity:get_user(user_id=1db35c40e944463587194d432aaf15bb)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:56.553340 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c5ef6-3b67-42bb-81b2-e2b1166031aa None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:56.555014 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 33/74] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 13 23:33:56 2022] GET /identity/v3/users/1db35c40e944463587194d432aaf15bb => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:33:56.556233 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d632e23-673f-4c17-ad6c-0f990463910d None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:56.556522 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d632e23-673f-4c17-ad6c-0f990463910d None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:56.556797 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d632e23-673f-4c17-ad6c-0f990463910d None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:56.558018 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 34/75] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:33:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:33:56.561383 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d632e23-673f-4c17-ad6c-0f990463910d None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:56.584664 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ad2e0-f306-421b-add4-e825981d1ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:56.585564 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ad2e0-f306-421b-add4-e825981d1ac6 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:56.585851 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ad2e0-f306-421b-add4-e825981d1ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:56.586130 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ad2e0-f306-421b-add4-e825981d1ac6 None admin] PATH_INFO: `/v3/users/d4a30dab8dc6492bb2bda65abda06d0d` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:56.587298 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ad2e0-f306-421b-add4-e825981d1ac6 None admin] RBAC: Authorizing `identity:get_user(user_id=d4a30dab8dc6492bb2bda65abda06d0d)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:56.588737 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ad2e0-f306-421b-add4-e825981d1ac6 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:56.591457 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 42/76] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 13 23:33:56 2022] GET /identity/v3/users/d4a30dab8dc6492bb2bda65abda06d0d => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:33:56.592745 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b846fa1-3899-4378-81d8-e5e6e1f5ab2f None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:56.593117 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b846fa1-3899-4378-81d8-e5e6e1f5ab2f None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:56.593400 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b846fa1-3899-4378-81d8-e5e6e1f5ab2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:56.610258 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-8b846fa1-3899-4378-81d8-e5e6e1f5ab2f None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:33:56.611378 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-8b846fa1-3899-4378-81d8-e5e6e1f5ab2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:33:56.657963 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:33:56.669725 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d632e23-673f-4c17-ad6c-0f990463910d None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:56.682154 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 43/77] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:33:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:33:56.683433 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b846fa1-3899-4378-81d8-e5e6e1f5ab2f None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:56.703059 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2fb61-de97-4bcf-b51b-2a4d8e9f8af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:56.703714 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2fb61-de97-4bcf-b51b-2a4d8e9f8af9 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:56.703999 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2fb61-de97-4bcf-b51b-2a4d8e9f8af9 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:56.704278 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2fb61-de97-4bcf-b51b-2a4d8e9f8af9 None admin] PATH_INFO: `/v3/roles` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:56.705043 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2fb61-de97-4bcf-b51b-2a4d8e9f8af9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:33:56.705355 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2fb61-de97-4bcf-b51b-2a4d8e9f8af9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:56.706894 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2fb61-de97-4bcf-b51b-2a4d8e9f8af9 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:56.714821 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 35/78] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 13 23:33:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:33:56.717599 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecf5a7-31ce-48c9-83bc-97b3a3047010 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:56.717900 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecf5a7-31ce-48c9-83bc-97b3a3047010 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:56.718247 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecf5a7-31ce-48c9-83bc-97b3a3047010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:56.735017 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-12ecf5a7-31ce-48c9-83bc-97b3a3047010 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:33:56.736220 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-12ecf5a7-31ce-48c9-83bc-97b3a3047010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:33:56.742000 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:33:56.801134 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 36/79] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:33:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:33:56.802043 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ecf5a7-31ce-48c9-83bc-97b3a3047010 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:56.803227 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b846fa1-3899-4378-81d8-e5e6e1f5ab2f None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:56.839389 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb5a33-ed81-4507-a60b-c4d88659a811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:56.840036 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb5a33-ed81-4507-a60b-c4d88659a811 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:56.840351 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb5a33-ed81-4507-a60b-c4d88659a811 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:56.840635 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb5a33-ed81-4507-a60b-c4d88659a811 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:56.881558 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:33:56.901498 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ecf5a7-31ce-48c9-83bc-97b3a3047010 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:56.908431 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb5a33-ed81-4507-a60b-c4d88659a811 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:56.909951 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb5a33-ed81-4507-a60b-c4d88659a811 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:56.936322 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fdfb62-2037-4552-ace6-a3a81bd6e3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:56.937031 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdfb62-2037-4552-ace6-a3a81bd6e3bc None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:56.937319 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdfb62-2037-4552-ace6-a3a81bd6e3bc None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:56.937597 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdfb62-2037-4552-ace6-a3a81bd6e3bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:56.948072 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:33:57.004902 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fdfb62-2037-4552-ace6-a3a81bd6e3bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:57.006382 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fdfb62-2037-4552-ace6-a3a81bd6e3bc None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:57.010811 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 44/80] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 13 23:33:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 23:33:57.013061 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb5a33-ed81-4507-a60b-c4d88659a811 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:57.086669 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:33:57.106653 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 37/81] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 13 23:33:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 23:33:57.107579 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fdfb62-2037-4552-ace6-a3a81bd6e3bc None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:57.110646 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb5a33-ed81-4507-a60b-c4d88659a811 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:57.144359 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdadd9b-0c6c-4b8d-88ce-6edd16824d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:57.145183 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdadd9b-0c6c-4b8d-88ce-6edd16824d64 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:57.145474 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdadd9b-0c6c-4b8d-88ce-6edd16824d64 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:57.145750 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdadd9b-0c6c-4b8d-88ce-6edd16824d64 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:57.152343 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:33:57.157439 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdadd9b-0c6c-4b8d-88ce-6edd16824d64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:33:57.165445 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-7fdadd9b-0c6c-4b8d-88ce-6edd16824d64 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 23:33:57.165445 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:33:57.165445 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:33:57.165445 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:33:57.165445 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:33:57.165445 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:33:57.165445 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:33:57.165445 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:33:57.165445 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:33:57.165445 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:33:57.165445 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:33:57.165445 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:33:57.165445 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:33:57.165445 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:33:57.165445 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:33:57.165445 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:33:57.166370 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:33:57.166370 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:33:57.166370 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:33:57.166370 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:33:57.166370 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:33:57.166370 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:33:57.166370 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:33:57.166370 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:33:57.166370 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:33:57.166370 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:33:57.166370 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:33:57.166370 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:33:57.166370 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:33:57.166370 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:33:57.166370 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:33:57.166370 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:33:57.172811 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:33:57.172811 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:33:57.172811 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:33:57.172811 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:33:57.172811 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:33:57.172811 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:33:57.172811 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:33:57.172811 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:33:57.172811 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:33:57.172811 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:33:57.172811 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 23:33:57.172811 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:33:57.172811 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 45/82] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:33:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:33:57.172811 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdadd9b-0c6c-4b8d-88ce-6edd16824d64 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:57.205129 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fdfb62-2037-4552-ace6-a3a81bd6e3bc None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:57.238316 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2b812-7f6b-46d3-a460-791eb4d837ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:57.239180 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2b812-7f6b-46d3-a460-791eb4d837ab None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:57.239468 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2b812-7f6b-46d3-a460-791eb4d837ab None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:57.239746 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2b812-7f6b-46d3-a460-791eb4d837ab None admin] PATH_INFO: `/v3/users/1db35c40e944463587194d432aaf15bb` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:57.240975 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a2b812-7f6b-46d3-a460-791eb4d837ab None admin] RBAC: Authorizing `identity:get_user(user_id=1db35c40e944463587194d432aaf15bb)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:57.242431 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a2b812-7f6b-46d3-a460-791eb4d837ab None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:57.244238 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 38/83] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 13 23:33:57 2022] GET /identity/v3/users/1db35c40e944463587194d432aaf15bb => generated 275 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:33:57.244810 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2b812-7f6b-46d3-a460-791eb4d837ab None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:57.274289 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdadd9b-0c6c-4b8d-88ce-6edd16824d64 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:57.293179 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:33:57.307678 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe93e03-392a-488e-9f81-1c2c51bed849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:57.308474 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe93e03-392a-488e-9f81-1c2c51bed849 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:57.308765 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe93e03-392a-488e-9f81-1c2c51bed849 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:57.309604 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe93e03-392a-488e-9f81-1c2c51bed849 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:57.310907 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe93e03-392a-488e-9f81-1c2c51bed849 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:57.312383 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe93e03-392a-488e-9f81-1c2c51bed849 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:57.314031 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 46/84] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:33:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:33:57.314796 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe93e03-392a-488e-9f81-1c2c51bed849 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:57.353207 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2b812-7f6b-46d3-a460-791eb4d837ab None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:57.381625 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:33:57.388926 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055548c5-b3f6-4f3f-a38b-687e4f713e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:57.389790 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055548c5-b3f6-4f3f-a38b-687e4f713e88 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:57.390073 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055548c5-b3f6-4f3f-a38b-687e4f713e88 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:57.390344 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055548c5-b3f6-4f3f-a38b-687e4f713e88 None admin] PATH_INFO: `/v3/projects/815dfc6ab25b4cac9e72ec762bd3d170` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:57.391534 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055548c5-b3f6-4f3f-a38b-687e4f713e88 None admin] RBAC: Authorizing `identity:get_project(project_id=815dfc6ab25b4cac9e72ec762bd3d170)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:57.393399 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055548c5-b3f6-4f3f-a38b-687e4f713e88 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:57.395495 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 39/85] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 13 23:33:57 2022] GET /identity/v3/projects/815dfc6ab25b4cac9e72ec762bd3d170 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:33:57.396520 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055548c5-b3f6-4f3f-a38b-687e4f713e88 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:57.422485 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe93e03-392a-488e-9f81-1c2c51bed849 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:57.456637 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d19fb-50d6-4172-806d-750977dd2bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:57.457705 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d19fb-50d6-4172-806d-750977dd2bdf None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:57.458062 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d19fb-50d6-4172-806d-750977dd2bdf None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:57.458351 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d19fb-50d6-4172-806d-750977dd2bdf None admin] PATH_INFO: `/v3/projects/815dfc6ab25b4cac9e72ec762bd3d170` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:57.459534 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7d19fb-50d6-4172-806d-750977dd2bdf None admin] RBAC: Authorizing `identity:get_project(project_id=815dfc6ab25b4cac9e72ec762bd3d170)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:57.461036 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7d19fb-50d6-4172-806d-750977dd2bdf None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:57.462718 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 47/86] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 13 23:33:57 2022] GET /identity/v3/projects/815dfc6ab25b4cac9e72ec762bd3d170 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:33:57.463490 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d19fb-50d6-4172-806d-750977dd2bdf None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:57.501226 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055548c5-b3f6-4f3f-a38b-687e4f713e88 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:57.518273 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:33:57.538115 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a534dba-a123-447f-9e81-d7a1705044c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:57.538785 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a534dba-a123-447f-9e81-d7a1705044c1 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:57.539069 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a534dba-a123-447f-9e81-d7a1705044c1 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:57.539343 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a534dba-a123-447f-9e81-d7a1705044c1 None admin] PATH_INFO: `/v3/roles` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:57.540077 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a534dba-a123-447f-9e81-d7a1705044c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:33:57.540382 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a534dba-a123-447f-9e81-d7a1705044c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:57.542184 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a534dba-a123-447f-9e81-d7a1705044c1 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:57.550566 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 40/87] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 13 23:33:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:33:57.551338 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a534dba-a123-447f-9e81-d7a1705044c1 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:57.570099 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d19fb-50d6-4172-806d-750977dd2bdf None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:57.603198 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720cb792-1ff1-4e5a-b552-133853606e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:57.603847 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720cb792-1ff1-4e5a-b552-133853606e64 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:57.604136 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720cb792-1ff1-4e5a-b552-133853606e64 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:57.604414 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720cb792-1ff1-4e5a-b552-133853606e64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:57.607777 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:33:57.658392 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a534dba-a123-447f-9e81-d7a1705044c1 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:57.674154 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720cb792-1ff1-4e5a-b552-133853606e64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:57.675635 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720cb792-1ff1-4e5a-b552-133853606e64 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:57.692483 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c906c93-6c1a-4cf0-9223-833c83e2cc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:57.693178 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c906c93-6c1a-4cf0-9223-833c83e2cc2b None admin] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:57.693467 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c906c93-6c1a-4cf0-9223-833c83e2cc2b None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:57.693745 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c906c93-6c1a-4cf0-9223-833c83e2cc2b None admin] PATH_INFO: `/v3/users` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:57.694448 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c906c93-6c1a-4cf0-9223-833c83e2cc2b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:57.695886 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c906c93-6c1a-4cf0-9223-833c83e2cc2b None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:57.721805 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 41/88] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jul 13 23:33:57 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 23:33:57.722780 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c906c93-6c1a-4cf0-9223-833c83e2cc2b None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:57.765402 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:33:57.799727 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 48/89] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 13 23:33:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 23:33:57.800618 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720cb792-1ff1-4e5a-b552-133853606e64 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:57.838961 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:33:57.841646 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c906c93-6c1a-4cf0-9223-833c83e2cc2b None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:57.888252 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08755968-e70e-40e9-95dd-5f84abbd0282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:57.889352 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08755968-e70e-40e9-95dd-5f84abbd0282 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:57.889864 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08755968-e70e-40e9-95dd-5f84abbd0282 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:57.890336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08755968-e70e-40e9-95dd-5f84abbd0282 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:57.891363 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08755968-e70e-40e9-95dd-5f84abbd0282 None admin] RBAC: Adding query filter params (role.id=69842edf01cf43eb814bb066f9652f48, scope.project.id=815dfc6ab25b4cac9e72ec762bd3d170, user.id=1db35c40e944463587194d432aaf15bb) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:33:57.891887 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08755968-e70e-40e9-95dd-5f84abbd0282 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:57.894200 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08755968-e70e-40e9-95dd-5f84abbd0282 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:57.901770 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 42/90] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 13 23:33:57 2022] GET /identity/v3/role_assignments?user.id=1db35c40e944463587194d432aaf15bb&scope.project.id=815dfc6ab25b4cac9e72ec762bd3d170&role.id=69842edf01cf43eb814bb066f9652f48 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:33:57.902576 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08755968-e70e-40e9-95dd-5f84abbd0282 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:57.921619 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720cb792-1ff1-4e5a-b552-133853606e64 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:57.973606 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c4a8e-63ca-4574-aba7-407ba8c76c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:57.974325 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c4a8e-63ca-4574-aba7-407ba8c76c63 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:57.974623 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c4a8e-63ca-4574-aba7-407ba8c76c63 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:57.974893 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c4a8e-63ca-4574-aba7-407ba8c76c63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:57.975755 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c4a8e-63ca-4574-aba7-407ba8c76c63 None admin] RBAC: Adding query filter params (role.id=46deff0e06964626a5600c9641454603, scope.project.id=815dfc6ab25b4cac9e72ec762bd3d170, user.id=d4a30dab8dc6492bb2bda65abda06d0d) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:33:57.976076 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c4a8e-63ca-4574-aba7-407ba8c76c63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:57.977703 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c4a8e-63ca-4574-aba7-407ba8c76c63 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:57.984291 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 49/91] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 13 23:33:57 2022] GET /identity/v3/role_assignments?user.id=d4a30dab8dc6492bb2bda65abda06d0d&scope.project.id=815dfc6ab25b4cac9e72ec762bd3d170&role.id=46deff0e06964626a5600c9641454603 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:33:57.985043 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c4a8e-63ca-4574-aba7-407ba8c76c63 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:58.060845 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08755968-e70e-40e9-95dd-5f84abbd0282 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:58.063754 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:33:58.124692 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef88748-d50e-4bb6-8bb8-e44e46d8bfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:58.125242 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef88748-d50e-4bb6-8bb8-e44e46d8bfc6 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:58.125535 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef88748-d50e-4bb6-8bb8-e44e46d8bfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:58.125819 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef88748-d50e-4bb6-8bb8-e44e46d8bfc6 None admin] PATH_INFO: `/v3/users/1db35c40e944463587194d432aaf15bb` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:58.127933 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef88748-d50e-4bb6-8bb8-e44e46d8bfc6 None admin] RBAC: Authorizing `identity:get_user(user_id=1db35c40e944463587194d432aaf15bb)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:58.129496 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef88748-d50e-4bb6-8bb8-e44e46d8bfc6 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:58.131242 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 43/92] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 13 23:33:57 2022] GET /identity/v3/users/1db35c40e944463587194d432aaf15bb => generated 275 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:33:58.138684 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef88748-d50e-4bb6-8bb8-e44e46d8bfc6 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:58.147669 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:33:58.154821 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c4a8e-63ca-4574-aba7-407ba8c76c63 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:58.200751 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769054ec-4f97-42f1-b1ad-8033ebef8e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:58.202152 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769054ec-4f97-42f1-b1ad-8033ebef8e11 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:58.202624 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769054ec-4f97-42f1-b1ad-8033ebef8e11 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:58.203085 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769054ec-4f97-42f1-b1ad-8033ebef8e11 None admin] PATH_INFO: `/v3/projects/815dfc6ab25b4cac9e72ec762bd3d170` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:58.204879 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769054ec-4f97-42f1-b1ad-8033ebef8e11 None admin] RBAC: Authorizing `identity:get_project(project_id=815dfc6ab25b4cac9e72ec762bd3d170)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:58.206647 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769054ec-4f97-42f1-b1ad-8033ebef8e11 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:58.208703 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 50/93] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 13 23:33:57 2022] GET /identity/v3/projects/815dfc6ab25b4cac9e72ec762bd3d170 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:33:58.214905 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769054ec-4f97-42f1-b1ad-8033ebef8e11 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:58.268288 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef88748-d50e-4bb6-8bb8-e44e46d8bfc6 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:58.311026 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8d967-39ac-4a34-80c4-7fdb8e8322e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:58.311702 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8d967-39ac-4a34-80c4-7fdb8e8322e0 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:58.312140 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8d967-39ac-4a34-80c4-7fdb8e8322e0 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:58.312577 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8d967-39ac-4a34-80c4-7fdb8e8322e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:58.330959 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769054ec-4f97-42f1-b1ad-8033ebef8e11 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:58.355623 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:33:58.368700 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb59e58a-ac13-4a67-ba29-0ca3b26f6192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:58.369724 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb59e58a-ac13-4a67-ba29-0ca3b26f6192 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:58.370195 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb59e58a-ac13-4a67-ba29-0ca3b26f6192 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:58.370657 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb59e58a-ac13-4a67-ba29-0ca3b26f6192 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:58.372298 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb59e58a-ac13-4a67-ba29-0ca3b26f6192 None admin] RBAC: Adding query filter params (role.id=a27ce0a47b0a4f9bac8c6e78d9da4278, scope.project.id=815dfc6ab25b4cac9e72ec762bd3d170, user.id=1db35c40e944463587194d432aaf15bb) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:33:58.372878 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb59e58a-ac13-4a67-ba29-0ca3b26f6192 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:58.374556 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb59e58a-ac13-4a67-ba29-0ca3b26f6192 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:58.380917 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 51/94] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 13 23:33:58 2022] GET /identity/v3/role_assignments?user.id=1db35c40e944463587194d432aaf15bb&scope.project.id=815dfc6ab25b4cac9e72ec762bd3d170&role.id=a27ce0a47b0a4f9bac8c6e78d9da4278 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:33:58.428766 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d8d967-39ac-4a34-80c4-7fdb8e8322e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:58.430270 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d8d967-39ac-4a34-80c4-7fdb8e8322e0 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:58.614051 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 44/95] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 13 23:33:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 23:33:58.619801 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb59e58a-ac13-4a67-ba29-0ca3b26f6192 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:58.667155 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:33:58.764435 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb59e58a-ac13-4a67-ba29-0ca3b26f6192 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:58.814974 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df70bd0-fffe-4a19-b432-01e846f516d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:58.816489 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df70bd0-fffe-4a19-b432-01e846f516d4 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:58.816974 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df70bd0-fffe-4a19-b432-01e846f516d4 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:58.817403 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df70bd0-fffe-4a19-b432-01e846f516d4 None admin] PATH_INFO: `/v3/projects/f254fe9b74f645758190ac34ac45b8be` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:58.821541 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df70bd0-fffe-4a19-b432-01e846f516d4 None admin] RBAC: Authorizing `identity:get_project(project_id=f254fe9b74f645758190ac34ac45b8be)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:58.823160 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df70bd0-fffe-4a19-b432-01e846f516d4 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:58.825082 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 52/96] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 13 23:33:58 2022] GET /identity/v3/projects/f254fe9b74f645758190ac34ac45b8be => generated 312 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:33:58.831287 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8d967-39ac-4a34-80c4-7fdb8e8322e0 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:33:58.937249 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:33:58.977597 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8d967-39ac-4a34-80c4-7fdb8e8322e0 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:33:59.034912 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc093d9-550d-43f2-9908-c27c2bfd8241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:33:59.035587 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc093d9-550d-43f2-9908-c27c2bfd8241 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:33:59.035876 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc093d9-550d-43f2-9908-c27c2bfd8241 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:33:59.036158 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc093d9-550d-43f2-9908-c27c2bfd8241 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:33:59.037032 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc093d9-550d-43f2-9908-c27c2bfd8241 None admin] RBAC: Adding query filter params (role.id=69842edf01cf43eb814bb066f9652f48, scope.project.id=f254fe9b74f645758190ac34ac45b8be, user.id=1db35c40e944463587194d432aaf15bb) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:33:59.037353 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc093d9-550d-43f2-9908-c27c2bfd8241 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:33:59.038821 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc093d9-550d-43f2-9908-c27c2bfd8241 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:33:59.049041 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 45/97] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 13 23:33:58 2022] GET /identity/v3/role_assignments?user.id=1db35c40e944463587194d432aaf15bb&scope.project.id=f254fe9b74f645758190ac34ac45b8be&role.id=69842edf01cf43eb814bb066f9652f48 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:01.098462 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbee5b-d20b-42cf-9383-3c3e172fdea9 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:01.099371 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbee5b-d20b-42cf-9383-3c3e172fdea9 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:01.099833 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbee5b-d20b-42cf-9383-3c3e172fdea9 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:01.101626 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 53/98] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:01.107510 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516927c-1b48-4e3b-bfc8-0c8e6b75de91 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:01.108349 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516927c-1b48-4e3b-bfc8-0c8e6b75de91 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:01.108880 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516927c-1b48-4e3b-bfc8-0c8e6b75de91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:01.133890 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-3516927c-1b48-4e3b-bfc8-0c8e6b75de91 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:01.135555 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-3516927c-1b48-4e3b-bfc8-0c8e6b75de91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:01.232804 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 46/99] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 23:34:01.269205 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbee5b-d20b-42cf-9383-3c3e172fdea9 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:01.342409 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02922145-486c-4508-987d-86c3d8ceca14 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:01.342744 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02922145-486c-4508-987d-86c3d8ceca14 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:01.343030 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02922145-486c-4508-987d-86c3d8ceca14 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:01.344592 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 47/100] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:01.349859 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f81825-b8c7-44f6-8952-76e7ea6c0a9f None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:01.350106 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f81825-b8c7-44f6-8952-76e7ea6c0a9f None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:01.350365 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f81825-b8c7-44f6-8952-76e7ea6c0a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:01.382097 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-04f81825-b8c7-44f6-8952-76e7ea6c0a9f None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:01.383354 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-04f81825-b8c7-44f6-8952-76e7ea6c0a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:01.416854 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:01.426668 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbee5b-d20b-42cf-9383-3c3e172fdea9 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:01.481324 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd18b0-2d45-44da-a806-21788d81d52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:01.482567 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd18b0-2d45-44da-a806-21788d81d52c None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:01.483070 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd18b0-2d45-44da-a806-21788d81d52c None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:01.483560 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd18b0-2d45-44da-a806-21788d81d52c None admin] PATH_INFO: `/v3/roles/member` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:01.513916 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cd18b0-2d45-44da-a806-21788d81d52c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:34:01.526562 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-05cd18b0-2d45-44da-a806-21788d81d52c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 23:34:01.526562 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:01.526562 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:01.526562 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:01.526562 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:01.526562 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:01.526562 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:01.526562 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:01.526562 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:01.526562 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:01.526562 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:01.526562 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:01.526562 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:34:01.526562 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:34:01.526562 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:34:01.526562 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:34:01.527554 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:34:01.527554 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:34:01.527554 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:34:01.527554 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:34:01.527554 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:01.527554 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:01.527554 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:01.527554 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:01.527554 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:01.527554 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:01.527554 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:01.527554 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:01.527554 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:01.527554 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:01.527554 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:01.527554 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:01.528425 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:01.528425 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:01.528425 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:01.528425 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:01.528425 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:34:01.528425 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:34:01.528425 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:34:01.528425 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:34:01.528425 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:34:01.528425 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:34:01.528425 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 23:34:01.528425 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:34:01.528425 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 54/101] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:34:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:01.535841 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd18b0-2d45-44da-a806-21788d81d52c None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:01.598166 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:01.627444 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 48/102] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 23:34:01.629094 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96794cfd-f63e-4453-a676-4c0d17948617 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:01.629604 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96794cfd-f63e-4453-a676-4c0d17948617 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:01.630070 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96794cfd-f63e-4453-a676-4c0d17948617 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:01.631526 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 49/103] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:01.639560 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f071e14-0b8c-4247-8f72-922ad61d52f0 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:01.641408 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f071e14-0b8c-4247-8f72-922ad61d52f0 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:01.641702 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f071e14-0b8c-4247-8f72-922ad61d52f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:01.678604 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-7f071e14-0b8c-4247-8f72-922ad61d52f0 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:01.679807 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-7f071e14-0b8c-4247-8f72-922ad61d52f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:01.763286 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd18b0-2d45-44da-a806-21788d81d52c None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:01.806857 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 50/104] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:34:01.807851 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f071e14-0b8c-4247-8f72-922ad61d52f0 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:01.826234 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499bfee1-2847-42b0-b363-ee2bb0312818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:01.828990 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499bfee1-2847-42b0-b363-ee2bb0312818 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:01.829456 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499bfee1-2847-42b0-b363-ee2bb0312818 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:01.829883 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499bfee1-2847-42b0-b363-ee2bb0312818 None admin] PATH_INFO: `/v3/roles` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:01.831979 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499bfee1-2847-42b0-b363-ee2bb0312818 None admin] RBAC: Adding query filter params (name=member) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:01.832461 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499bfee1-2847-42b0-b363-ee2bb0312818 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:01.834724 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499bfee1-2847-42b0-b363-ee2bb0312818 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:01.846441 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 55/105] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 13 23:34:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:34:01.847977 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379e471-d6c8-4fc5-bfc8-7d9a91cadb28 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:01.848425 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379e471-d6c8-4fc5-bfc8-7d9a91cadb28 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:01.848885 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379e471-d6c8-4fc5-bfc8-7d9a91cadb28 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:01.850244 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 56/106] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:01.851093 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d379e471-d6c8-4fc5-bfc8-7d9a91cadb28 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:01.885319 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:01.939269 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f071e14-0b8c-4247-8f72-922ad61d52f0 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:01.964370 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:01.972566 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d379e471-d6c8-4fc5-bfc8-7d9a91cadb28 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:01.977418 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f5b5c-8906-4df6-b70d-9368453131eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:01.978509 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f5b5c-8906-4df6-b70d-9368453131eb None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:01.979010 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f5b5c-8906-4df6-b70d-9368453131eb None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:01.979496 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f5b5c-8906-4df6-b70d-9368453131eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:01.981175 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f5b5c-8906-4df6-b70d-9368453131eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:01.983033 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f5b5c-8906-4df6-b70d-9368453131eb None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:01.985224 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 51/107] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:34:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:01.986255 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f5b5c-8906-4df6-b70d-9368453131eb None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:02.011267 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b639bd-f9d4-46c3-a717-a5ccd10d06e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:02.013282 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b639bd-f9d4-46c3-a717-a5ccd10d06e8 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:02.013959 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b639bd-f9d4-46c3-a717-a5ccd10d06e8 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:02.014474 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b639bd-f9d4-46c3-a717-a5ccd10d06e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:02.025948 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b639bd-f9d4-46c3-a717-a5ccd10d06e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:34:02.035335 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-90b639bd-f9d4-46c3-a717-a5ccd10d06e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 23:34:02.035335 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:02.035335 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:02.035335 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:02.035335 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:02.035335 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:02.035335 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:02.035335 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:02.035335 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:02.035335 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:02.035335 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:02.035335 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:02.035335 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:34:02.035335 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:34:02.035335 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:34:02.035335 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:34:02.036411 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:34:02.036411 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:34:02.036411 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:34:02.036411 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:34:02.036411 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:02.036411 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:02.036411 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:02.036411 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:02.036411 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:02.036411 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:02.036411 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:02.036411 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:02.036411 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:02.036411 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:02.036411 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:02.036411 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:02.037344 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:02.037344 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:02.037344 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:02.037344 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:02.037344 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:34:02.037344 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:34:02.037344 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:34:02.037344 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:34:02.037344 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:34:02.037344 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:34:02.037344 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 23:34:02.037344 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:34:02.039306 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 57/108] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 13 23:34:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:02.040642 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27c51f-2925-4183-a232-2a2b40eb87dd None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:02.041111 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27c51f-2925-4183-a232-2a2b40eb87dd None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:02.041535 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27c51f-2925-4183-a232-2a2b40eb87dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:02.060497 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-ba27c51f-2925-4183-a232-2a2b40eb87dd None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:02.062175 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-ba27c51f-2925-4183-a232-2a2b40eb87dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:02.098829 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f5b5c-8906-4df6-b70d-9368453131eb None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:02.135025 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc7ce5-faed-48c6-84c7-ed6d1cae2d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:02.135959 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc7ce5-faed-48c6-84c7-ed6d1cae2d77 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:02.136188 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc7ce5-faed-48c6-84c7-ed6d1cae2d77 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:02.136459 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc7ce5-faed-48c6-84c7-ed6d1cae2d77 None admin] PATH_INFO: `/v3/users/1db35c40e944463587194d432aaf15bb` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:02.138668 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcc7ce5-faed-48c6-84c7-ed6d1cae2d77 None admin] RBAC: Authorizing `identity:get_user(user_id=1db35c40e944463587194d432aaf15bb)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:02.138769 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 58/109] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:34:02.139990 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcc7ce5-faed-48c6-84c7-ed6d1cae2d77 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:02.141766 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 52/110] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 13 23:34:01 2022] GET /identity/v3/users/1db35c40e944463587194d432aaf15bb => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:02.145780 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba27c51f-2925-4183-a232-2a2b40eb87dd None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:02.146850 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc7ce5-faed-48c6-84c7-ed6d1cae2d77 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:02.161717 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:02.214327 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:02.260849 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba27c51f-2925-4183-a232-2a2b40eb87dd None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:02.265188 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc7ce5-faed-48c6-84c7-ed6d1cae2d77 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:02.297111 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32b0e5-6fbe-471c-bf15-6bd584326f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:02.297782 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32b0e5-6fbe-471c-bf15-6bd584326f3f None admin] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:02.298059 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32b0e5-6fbe-471c-bf15-6bd584326f3f None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:02.298341 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32b0e5-6fbe-471c-bf15-6bd584326f3f None admin] PATH_INFO: `/v3/projects` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:02.299044 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a32b0e5-6fbe-471c-bf15-6bd584326f3f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:02.299980 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c48374-8f63-4717-a19f-eeae688a37b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:02.300503 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a32b0e5-6fbe-471c-bf15-6bd584326f3f None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:02.300670 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c48374-8f63-4717-a19f-eeae688a37b5 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:02.300962 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c48374-8f63-4717-a19f-eeae688a37b5 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:02.301240 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c48374-8f63-4717-a19f-eeae688a37b5 None admin] PATH_INFO: `/v3/roles` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:02.301979 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c48374-8f63-4717-a19f-eeae688a37b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:02.302289 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c48374-8f63-4717-a19f-eeae688a37b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:02.303641 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c48374-8f63-4717-a19f-eeae688a37b5 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:02.312986 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 53/111] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:34:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:02.314408 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81eb70-9a1c-456e-9772-62b745f35349 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:02.314700 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81eb70-9a1c-456e-9772-62b745f35349 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:02.314972 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81eb70-9a1c-456e-9772-62b745f35349 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:02.316187 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 54/112] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:02.321026 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81eb70-9a1c-456e-9772-62b745f35349 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:02.332518 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 59/113] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jul 13 23:34:02 2022] POST /identity/v3/projects => generated 302 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 23:34:02.333263 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32b0e5-6fbe-471c-bf15-6bd584326f3f None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:02.411482 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:02.458503 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32b0e5-6fbe-471c-bf15-6bd584326f3f None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:02.475238 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81eb70-9a1c-456e-9772-62b745f35349 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:02.500333 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247226c6-67e6-486b-9caf-3c291e140e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:02.500878 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:02.501194 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247226c6-67e6-486b-9caf-3c291e140e41 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:02.501480 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247226c6-67e6-486b-9caf-3c291e140e41 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:02.501763 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247226c6-67e6-486b-9caf-3c291e140e41 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:02.515952 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247226c6-67e6-486b-9caf-3c291e140e41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:34:02.521245 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6326c78-c4c0-48ab-8925-1b457b153347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:02.522481 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6326c78-c4c0-48ab-8925-1b457b153347 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:02.522988 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6326c78-c4c0-48ab-8925-1b457b153347 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:02.523468 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6326c78-c4c0-48ab-8925-1b457b153347 None admin] PATH_INFO: `/v3/projects/815dfc6ab25b4cac9e72ec762bd3d170` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:02.525021 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6326c78-c4c0-48ab-8925-1b457b153347 None admin] RBAC: Authorizing `identity:get_project(project_id=815dfc6ab25b4cac9e72ec762bd3d170)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:02.528033 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6326c78-c4c0-48ab-8925-1b457b153347 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:02.529148 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-247226c6-67e6-486b-9caf-3c291e140e41 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 23:34:02.529148 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:02.529148 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:02.529148 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:02.529148 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:02.529148 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:02.529148 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:02.529148 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:02.529148 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:02.529148 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:02.529148 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:02.529148 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:02.529148 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:34:02.529148 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:34:02.529148 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:34:02.529148 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:34:02.529982 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:34:02.529982 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:34:02.529982 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:34:02.529982 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:34:02.529982 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:02.529982 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:02.529982 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:02.529982 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:02.529982 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:02.529982 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:02.529982 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:02.529982 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:02.529982 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:02.529982 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:02.529982 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:02.529982 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:02.530771 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:02.530771 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:02.530771 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:02.530771 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:02.530771 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:34:02.530771 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:34:02.530771 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:34:02.530771 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:34:02.530771 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:34:02.530771 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:34:02.530771 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 23:34:02.530771 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:34:02.531362 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 60/114] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:34:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:02.536568 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247226c6-67e6-486b-9caf-3c291e140e41 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:02.536704 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 55/115] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 13 23:34:02 2022] GET /identity/v3/projects/815dfc6ab25b4cac9e72ec762bd3d170 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:02.536704 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad0efa-8058-491c-bed1-864d0137ec9f None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:02.536704 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad0efa-8058-491c-bed1-864d0137ec9f None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:02.536704 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad0efa-8058-491c-bed1-864d0137ec9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:02.558487 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-2fad0efa-8058-491c-bed1-864d0137ec9f None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:02.561203 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-2fad0efa-8058-491c-bed1-864d0137ec9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:02.636492 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 56/116] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:34:02.638020 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad0efa-8058-491c-bed1-864d0137ec9f None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:02.666410 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247226c6-67e6-486b-9caf-3c291e140e41 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:02.692251 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:02.704807 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf573ce-9d17-486f-b439-82bfcb0ef831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:02.705830 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf573ce-9d17-486f-b439-82bfcb0ef831 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:02.706116 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf573ce-9d17-486f-b439-82bfcb0ef831 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:02.706394 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf573ce-9d17-486f-b439-82bfcb0ef831 None admin] PATH_INFO: `/v3/users/d4a30dab8dc6492bb2bda65abda06d0d` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:02.707589 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf573ce-9d17-486f-b439-82bfcb0ef831 None admin] RBAC: Authorizing `identity:get_user(user_id=d4a30dab8dc6492bb2bda65abda06d0d)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:02.709080 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf573ce-9d17-486f-b439-82bfcb0ef831 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:02.710703 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 61/117] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 13 23:34:02 2022] GET /identity/v3/users/d4a30dab8dc6492bb2bda65abda06d0d => generated 247 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:02.716000 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf573ce-9d17-486f-b439-82bfcb0ef831 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:02.749292 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad0efa-8058-491c-bed1-864d0137ec9f None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:02.768507 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:02.788278 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f230452-347a-4466-abe3-4558293dcb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:02.788988 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f230452-347a-4466-abe3-4558293dcb39 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:02.789281 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f230452-347a-4466-abe3-4558293dcb39 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:02.789564 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f230452-347a-4466-abe3-4558293dcb39 None admin] PATH_INFO: `/v3/roles` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:02.790309 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f230452-347a-4466-abe3-4558293dcb39 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:02.790621 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f230452-347a-4466-abe3-4558293dcb39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:02.792256 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f230452-347a-4466-abe3-4558293dcb39 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:02.801833 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 57/118] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 13 23:34:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:02.803107 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59985d11-e475-48cf-9904-4c32854eca79 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:02.803401 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59985d11-e475-48cf-9904-4c32854eca79 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:02.803680 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59985d11-e475-48cf-9904-4c32854eca79 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:02.809021 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 58/119] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:02.809021 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59985d11-e475-48cf-9904-4c32854eca79 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:02.829982 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf573ce-9d17-486f-b439-82bfcb0ef831 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:02.869919 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1af1d4a-7c40-4290-896a-f874c0b3136b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:02.870810 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af1d4a-7c40-4290-896a-f874c0b3136b None admin] REQUEST_METHOD: `PUT` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:02.871097 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af1d4a-7c40-4290-896a-f874c0b3136b None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:02.871661 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af1d4a-7c40-4290-896a-f874c0b3136b None admin] PATH_INFO: `/v3/projects/815dfc6ab25b4cac9e72ec762bd3d170/users/1db35c40e944463587194d432aaf15bb/roles/69842edf01cf43eb814bb066f9652f48` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:02.873508 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1af1d4a-7c40-4290-896a-f874c0b3136b None admin] RBAC: Authorizing `identity:create_grant(project_id=815dfc6ab25b4cac9e72ec762bd3d170, user_id=1db35c40e944463587194d432aaf15bb, role_id=69842edf01cf43eb814bb066f9652f48)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:02.874974 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1af1d4a-7c40-4290-896a-f874c0b3136b None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:02.894427 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 62/120] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jul 13 23:34:02 2022] PUT /identity/v3/projects/815dfc6ab25b4cac9e72ec762bd3d170/users/1db35c40e944463587194d432aaf15bb/roles/69842edf01cf43eb814bb066f9652f48 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 23:34:02.901101 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1af1d4a-7c40-4290-896a-f874c0b3136b None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:02.925548 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59985d11-e475-48cf-9904-4c32854eca79 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:02.975579 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:02.981651 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca523f22-a82f-4bd8-aa33-42d1cf1a3a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:02.983460 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca523f22-a82f-4bd8-aa33-42d1cf1a3a78 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:02.983888 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca523f22-a82f-4bd8-aa33-42d1cf1a3a78 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:02.984294 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca523f22-a82f-4bd8-aa33-42d1cf1a3a78 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:03.001068 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca523f22-a82f-4bd8-aa33-42d1cf1a3a78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:34:03.009644 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-ca523f22-a82f-4bd8-aa33-42d1cf1a3a78 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 23:34:03.009644 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:03.009644 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:03.009644 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:03.009644 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:03.009644 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:03.009644 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:03.009644 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:03.009644 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:03.009644 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:03.009644 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:03.009644 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:03.009644 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:34:03.009644 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:34:03.009644 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:34:03.009644 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:34:03.010738 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:34:03.010738 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:34:03.010738 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:34:03.010738 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:34:03.010738 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:03.010738 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:03.010738 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:03.010738 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:03.010738 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:03.010738 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:03.010738 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:03.010738 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:03.010738 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:03.010738 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:03.010738 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:03.010738 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:03.011478 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:03.011478 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:03.011478 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:03.011478 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:03.011478 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:34:03.011478 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:34:03.011478 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:34:03.011478 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:34:03.011478 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:34:03.011478 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:34:03.011478 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 23:34:03.011478 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:34:03.013099 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 59/121] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jul 13 23:34:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:03.014266 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca523f22-a82f-4bd8-aa33-42d1cf1a3a78 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:03.046366 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1af1d4a-7c40-4290-896a-f874c0b3136b None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:03.061505 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:03.089638 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b8c9d-6231-4d3f-b8bb-7392ade225bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:03.091032 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b8c9d-6231-4d3f-b8bb-7392ade225bb None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:03.091469 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b8c9d-6231-4d3f-b8bb-7392ade225bb None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:03.091759 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b8c9d-6231-4d3f-b8bb-7392ade225bb None admin] PATH_INFO: `/v3/projects/815dfc6ab25b4cac9e72ec762bd3d170` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:03.093083 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b8c9d-6231-4d3f-b8bb-7392ade225bb None admin] RBAC: Authorizing `identity:get_project(project_id=815dfc6ab25b4cac9e72ec762bd3d170)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:03.094560 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b8c9d-6231-4d3f-b8bb-7392ade225bb None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:03.100770 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 63/122] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 13 23:34:02 2022] GET /identity/v3/projects/815dfc6ab25b4cac9e72ec762bd3d170 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:03.100770 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdf042-a02c-4484-bc4a-4e3309e47def None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:03.100770 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdf042-a02c-4484-bc4a-4e3309e47def None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:03.100770 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdf042-a02c-4484-bc4a-4e3309e47def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:03.126561 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-c5cdf042-a02c-4484-bc4a-4e3309e47def None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:03.128511 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-c5cdf042-a02c-4484-bc4a-4e3309e47def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:03.136385 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca523f22-a82f-4bd8-aa33-42d1cf1a3a78 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:03.183947 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31d704-8205-43ff-975a-0e028021ef6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:03.186339 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31d704-8205-43ff-975a-0e028021ef6f None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:03.186816 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31d704-8205-43ff-975a-0e028021ef6f None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:03.187246 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31d704-8205-43ff-975a-0e028021ef6f None admin] PATH_INFO: `/v3/users/2b4b23446cd74e6a9b2fbfa174be84a9` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:03.207646 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a31d704-8205-43ff-975a-0e028021ef6f None admin] RBAC: Authorizing `identity:get_user(user_id=2b4b23446cd74e6a9b2fbfa174be84a9)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:03.210353 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a31d704-8205-43ff-975a-0e028021ef6f None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:03.213832 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 60/123] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 13 23:34:03 2022] GET /identity/v3/users/2b4b23446cd74e6a9b2fbfa174be84a9 => generated 289 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:03.219909 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31d704-8205-43ff-975a-0e028021ef6f None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:03.221750 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 64/124] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:34:03.222688 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cdf042-a02c-4484-bc4a-4e3309e47def None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:03.286502 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:03.340278 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:03.343098 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cdf042-a02c-4484-bc4a-4e3309e47def None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:03.343939 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31d704-8205-43ff-975a-0e028021ef6f None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:03.380666 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885ba08-24a2-42ea-8f88-026e99a8105b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:03.381999 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885ba08-24a2-42ea-8f88-026e99a8105b None admin] REQUEST_METHOD: `PUT` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:03.382431 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885ba08-24a2-42ea-8f88-026e99a8105b None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:03.382541 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeadb1a-a878-4edc-acc8-9ce8d98cb4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:03.382960 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885ba08-24a2-42ea-8f88-026e99a8105b None admin] PATH_INFO: `/v3/projects/815dfc6ab25b4cac9e72ec762bd3d170/users/d4a30dab8dc6492bb2bda65abda06d0d/roles/46deff0e06964626a5600c9641454603` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:03.383110 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeadb1a-a878-4edc-acc8-9ce8d98cb4ad None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:03.383399 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeadb1a-a878-4edc-acc8-9ce8d98cb4ad None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:03.383679 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeadb1a-a878-4edc-acc8-9ce8d98cb4ad None admin] PATH_INFO: `/v3/roles` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:03.384412 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeadb1a-a878-4edc-acc8-9ce8d98cb4ad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:03.384718 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeadb1a-a878-4edc-acc8-9ce8d98cb4ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:03.385864 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b885ba08-24a2-42ea-8f88-026e99a8105b None admin] RBAC: Authorizing `identity:create_grant(project_id=815dfc6ab25b4cac9e72ec762bd3d170, user_id=d4a30dab8dc6492bb2bda65abda06d0d, role_id=46deff0e06964626a5600c9641454603)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:03.386111 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeadb1a-a878-4edc-acc8-9ce8d98cb4ad None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:03.388743 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b885ba08-24a2-42ea-8f88-026e99a8105b None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:03.400054 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 61/125] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 13 23:34:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:03.400054 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeadb1a-a878-4edc-acc8-9ce8d98cb4ad None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:03.416852 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 65/126] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jul 13 23:34:03 2022] PUT /identity/v3/projects/815dfc6ab25b4cac9e72ec762bd3d170/users/d4a30dab8dc6492bb2bda65abda06d0d/roles/46deff0e06964626a5600c9641454603 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 23:34:03.419949 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885ba08-24a2-42ea-8f88-026e99a8105b None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:03.615683 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeadb1a-a878-4edc-acc8-9ce8d98cb4ad None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:03.636364 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885ba08-24a2-42ea-8f88-026e99a8105b None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:03.650189 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:03.669404 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3bdf1-f43d-4303-b276-bcb15e7782b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:03.670071 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3bdf1-f43d-4303-b276-bcb15e7782b1 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:03.670355 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3bdf1-f43d-4303-b276-bcb15e7782b1 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:03.670627 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3bdf1-f43d-4303-b276-bcb15e7782b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:03.683261 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68c112-f027-4474-90b1-825bb6a28c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:03.685015 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68c112-f027-4474-90b1-825bb6a28c1b None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:03.685524 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68c112-f027-4474-90b1-825bb6a28c1b None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:03.686001 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68c112-f027-4474-90b1-825bb6a28c1b None admin] PATH_INFO: `/v3/roles/member` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:03.698522 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68c112-f027-4474-90b1-825bb6a28c1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:34:03.705856 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:03.709016 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-fe68c112-f027-4474-90b1-825bb6a28c1b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 23:34:03.709016 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:03.709016 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:03.709016 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:03.709016 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:03.709016 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:03.709016 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:03.709016 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:03.709016 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:03.709016 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:03.709016 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:03.709016 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:03.709016 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:34:03.709016 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:34:03.709016 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:34:03.709016 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:34:03.709915 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:34:03.709915 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:34:03.709915 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:34:03.709915 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:34:03.709915 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:03.709915 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:03.709915 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:03.709915 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:03.709915 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:03.709915 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:03.709915 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:03.709915 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:03.709915 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:03.709915 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:03.709915 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:03.709915 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:03.710715 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:03.710715 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:03.710715 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:03.710715 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:03.710715 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:34:03.710715 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:34:03.710715 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:34:03.710715 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:34:03.710715 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:34:03.710715 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:34:03.710715 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 23:34:03.710715 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:34:03.713140 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 66/127] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:34:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:03.714175 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68c112-f027-4474-90b1-825bb6a28c1b None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:03.760187 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3bdf1-f43d-4303-b276-bcb15e7782b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:03.763460 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3bdf1-f43d-4303-b276-bcb15e7782b1 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:03.891148 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68c112-f027-4474-90b1-825bb6a28c1b None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:03.921316 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 62/128] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 13 23:34:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 23:34:03.922772 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3bdf1-f43d-4303-b276-bcb15e7782b1 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:03.985533 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec85868-7988-4f3e-9922-e18b907aabbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:03.986421 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec85868-7988-4f3e-9922-e18b907aabbe None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:03.986706 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec85868-7988-4f3e-9922-e18b907aabbe None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:03.987006 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec85868-7988-4f3e-9922-e18b907aabbe None admin] PATH_INFO: `/v3/users/1db35c40e944463587194d432aaf15bb` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:03.988344 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec85868-7988-4f3e-9922-e18b907aabbe None admin] RBAC: Authorizing `identity:get_user(user_id=1db35c40e944463587194d432aaf15bb)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:03.989824 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec85868-7988-4f3e-9922-e18b907aabbe None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:03.991736 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 67/129] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 13 23:34:03 2022] GET /identity/v3/users/1db35c40e944463587194d432aaf15bb => generated 275 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:03.992520 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec85868-7988-4f3e-9922-e18b907aabbe None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:03.999873 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:04.047609 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3bdf1-f43d-4303-b276-bcb15e7782b1 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:04.087703 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d5ee9e-734c-45cc-8389-a3d1e15a4c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:04.088731 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5ee9e-734c-45cc-8389-a3d1e15a4c4c None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:04.089243 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5ee9e-734c-45cc-8389-a3d1e15a4c4c None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:04.090721 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5ee9e-734c-45cc-8389-a3d1e15a4c4c None admin] PATH_INFO: `/v3/roles` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:04.092382 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d5ee9e-734c-45cc-8389-a3d1e15a4c4c None admin] RBAC: Adding query filter params (name=member) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:04.093064 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d5ee9e-734c-45cc-8389-a3d1e15a4c4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:04.094699 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d5ee9e-734c-45cc-8389-a3d1e15a4c4c None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:04.104475 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 63/130] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 13 23:34:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:04.106768 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:04.107739 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d5ee9e-734c-45cc-8389-a3d1e15a4c4c None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:04.225684 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec85868-7988-4f3e-9922-e18b907aabbe None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:04.244225 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d5ee9e-734c-45cc-8389-a3d1e15a4c4c None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:04.271173 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:04.283645 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9e5e5-71e5-450e-8e3c-bd806512ef37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:04.284930 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9e5e5-71e5-450e-8e3c-bd806512ef37 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:04.285576 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9e5e5-71e5-450e-8e3c-bd806512ef37 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:04.286159 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9e5e5-71e5-450e-8e3c-bd806512ef37 None admin] PATH_INFO: `/v3/projects/815dfc6ab25b4cac9e72ec762bd3d170` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:04.287807 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd9e5e5-71e5-450e-8e3c-bd806512ef37 None admin] RBAC: Authorizing `identity:get_project(project_id=815dfc6ab25b4cac9e72ec762bd3d170)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:04.289613 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd9e5e5-71e5-450e-8e3c-bd806512ef37 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:04.291715 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 64/131] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 13 23:34:04 2022] GET /identity/v3/projects/815dfc6ab25b4cac9e72ec762bd3d170 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:04.292775 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090c8e2-46de-4dca-be72-6fac135360dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:04.293050 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9e5e5-71e5-450e-8e3c-bd806512ef37 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:04.298362 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090c8e2-46de-4dca-be72-6fac135360dc None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:04.298362 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090c8e2-46de-4dca-be72-6fac135360dc None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:04.298362 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090c8e2-46de-4dca-be72-6fac135360dc None admin] PATH_INFO: `/v3/projects/815dfc6ab25b4cac9e72ec762bd3d170` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:04.299391 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8090c8e2-46de-4dca-be72-6fac135360dc None admin] RBAC: Authorizing `identity:get_project(project_id=815dfc6ab25b4cac9e72ec762bd3d170)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:04.300947 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8090c8e2-46de-4dca-be72-6fac135360dc None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:04.303638 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 68/132] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 13 23:34:03 2022] GET /identity/v3/projects/815dfc6ab25b4cac9e72ec762bd3d170 => generated 298 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:04.303638 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090c8e2-46de-4dca-be72-6fac135360dc None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:04.411362 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9e5e5-71e5-450e-8e3c-bd806512ef37 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:04.447535 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05dd057-9f18-4794-b472-4d5ea7d6d07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:04.448917 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05dd057-9f18-4794-b472-4d5ea7d6d07d None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:04.449941 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05dd057-9f18-4794-b472-4d5ea7d6d07d None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:04.450659 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05dd057-9f18-4794-b472-4d5ea7d6d07d None admin] PATH_INFO: `/v3/users/1db35c40e944463587194d432aaf15bb` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:04.452217 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05dd057-9f18-4794-b472-4d5ea7d6d07d None admin] RBAC: Authorizing `identity:get_user(user_id=1db35c40e944463587194d432aaf15bb)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:04.454065 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05dd057-9f18-4794-b472-4d5ea7d6d07d None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:04.455943 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 65/133] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 13 23:34:04 2022] GET /identity/v3/users/1db35c40e944463587194d432aaf15bb => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:04.456923 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05dd057-9f18-4794-b472-4d5ea7d6d07d None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:04.534694 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090c8e2-46de-4dca-be72-6fac135360dc None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:04.537051 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:04.544719 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:04.580915 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1541ad-9ab7-410e-8388-a8a92d1158bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:04.583141 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1541ad-9ab7-410e-8388-a8a92d1158bb None admin] REQUEST_METHOD: `PUT` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:04.583436 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1541ad-9ab7-410e-8388-a8a92d1158bb None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:04.583725 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1541ad-9ab7-410e-8388-a8a92d1158bb None admin] PATH_INFO: `/v3/projects/815dfc6ab25b4cac9e72ec762bd3d170/users/1db35c40e944463587194d432aaf15bb/roles/a27ce0a47b0a4f9bac8c6e78d9da4278` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:04.592853 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1541ad-9ab7-410e-8388-a8a92d1158bb None admin] RBAC: Authorizing `identity:create_grant(project_id=815dfc6ab25b4cac9e72ec762bd3d170, user_id=1db35c40e944463587194d432aaf15bb, role_id=a27ce0a47b0a4f9bac8c6e78d9da4278)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:04.596844 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1541ad-9ab7-410e-8388-a8a92d1158bb None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:04.610309 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05dd057-9f18-4794-b472-4d5ea7d6d07d None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:04.632340 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 69/134] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jul 13 23:34:04 2022] PUT /identity/v3/projects/815dfc6ab25b4cac9e72ec762bd3d170/users/1db35c40e944463587194d432aaf15bb/roles/a27ce0a47b0a4f9bac8c6e78d9da4278 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 23:34:04.633263 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1541ad-9ab7-410e-8388-a8a92d1158bb None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:04.691402 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece5710-f6d3-4062-b22d-dbb31532abdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:04.692879 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece5710-f6d3-4062-b22d-dbb31532abdd None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:04.693178 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece5710-f6d3-4062-b22d-dbb31532abdd None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:04.693462 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece5710-f6d3-4062-b22d-dbb31532abdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:04.695763 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece5710-f6d3-4062-b22d-dbb31532abdd None admin] RBAC: Adding query filter params (role.id=ef94ce01ebc74f67b71913824c20fbe4, scope.project.id=815dfc6ab25b4cac9e72ec762bd3d170, user.id=2b4b23446cd74e6a9b2fbfa174be84a9) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:04.696090 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece5710-f6d3-4062-b22d-dbb31532abdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:04.697588 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece5710-f6d3-4062-b22d-dbb31532abdd None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:04.712851 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 66/135] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 13 23:34:04 2022] GET /identity/v3/role_assignments?user.id=2b4b23446cd74e6a9b2fbfa174be84a9&scope.project.id=815dfc6ab25b4cac9e72ec762bd3d170&role.id=ef94ce01ebc74f67b71913824c20fbe4 => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:04.807922 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1541ad-9ab7-410e-8388-a8a92d1158bb None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:04.860356 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf411dff-09ac-4ec6-bdf4-2dc24315dd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:04.861181 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf411dff-09ac-4ec6-bdf4-2dc24315dd88 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:04.864780 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf411dff-09ac-4ec6-bdf4-2dc24315dd88 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:04.865099 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf411dff-09ac-4ec6-bdf4-2dc24315dd88 None admin] PATH_INFO: `/v3/projects/f254fe9b74f645758190ac34ac45b8be` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:04.866560 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf411dff-09ac-4ec6-bdf4-2dc24315dd88 None admin] RBAC: Authorizing `identity:get_project(project_id=f254fe9b74f645758190ac34ac45b8be)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:04.868066 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf411dff-09ac-4ec6-bdf4-2dc24315dd88 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:04.869864 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 70/136] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 13 23:34:04 2022] GET /identity/v3/projects/f254fe9b74f645758190ac34ac45b8be => generated 312 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:04.876516 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece5710-f6d3-4062-b22d-dbb31532abdd None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:04.908790 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963b032-1c1e-461c-8daa-9661550698ac None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:04.909118 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963b032-1c1e-461c-8daa-9661550698ac None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:04.909402 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963b032-1c1e-461c-8daa-9661550698ac None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:04.911033 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 71/137] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 23:34:04.922679 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44759f0-7eab-46e8-aa0a-31c99b58dc25 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:04.922994 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44759f0-7eab-46e8-aa0a-31c99b58dc25 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:04.923246 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44759f0-7eab-46e8-aa0a-31c99b58dc25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:04.943528 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-a44759f0-7eab-46e8-aa0a-31c99b58dc25 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:04.946029 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-a44759f0-7eab-46e8-aa0a-31c99b58dc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:04.997266 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:05.082497 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 72/138] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 23:34:05.096394 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece5710-f6d3-4062-b22d-dbb31532abdd None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:05.117474 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44759f0-7eab-46e8-aa0a-31c99b58dc25 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:05.137256 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:05.164147 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91248f3-a0c9-4be7-ba52-e12c3b225ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:05.165179 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91248f3-a0c9-4be7-ba52-e12c3b225ec3 None admin] REQUEST_METHOD: `PUT` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:05.165468 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91248f3-a0c9-4be7-ba52-e12c3b225ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:05.165748 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91248f3-a0c9-4be7-ba52-e12c3b225ec3 None admin] PATH_INFO: `/v3/projects/f254fe9b74f645758190ac34ac45b8be/users/1db35c40e944463587194d432aaf15bb/roles/69842edf01cf43eb814bb066f9652f48` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:05.171036 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91248f3-a0c9-4be7-ba52-e12c3b225ec3 None admin] RBAC: Authorizing `identity:create_grant(project_id=f254fe9b74f645758190ac34ac45b8be, user_id=1db35c40e944463587194d432aaf15bb, role_id=69842edf01cf43eb814bb066f9652f48)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:05.172568 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91248f3-a0c9-4be7-ba52-e12c3b225ec3 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:05.197885 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 67/139] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jul 13 23:34:04 2022] PUT /identity/v3/projects/f254fe9b74f645758190ac34ac45b8be/users/1db35c40e944463587194d432aaf15bb/roles/69842edf01cf43eb814bb066f9652f48 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 23:34:05.289045 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44759f0-7eab-46e8-aa0a-31c99b58dc25 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:05.339966 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b94ec2-211b-463a-b663-c7a26dafa3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:05.340748 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b94ec2-211b-463a-b663-c7a26dafa3c3 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:05.341063 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b94ec2-211b-463a-b663-c7a26dafa3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:05.341336 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b94ec2-211b-463a-b663-c7a26dafa3c3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:05.345668 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b94ec2-211b-463a-b663-c7a26dafa3c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:05.347178 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b94ec2-211b-463a-b663-c7a26dafa3c3 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:05.349267 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 73/140] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:34:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:05.354908 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91248f3-a0c9-4be7-ba52-e12c3b225ec3 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:05.485447 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91248f3-a0c9-4be7-ba52-e12c3b225ec3 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:05.531533 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ad20d-96ef-4f5b-bcf7-e58bc4717a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:05.532237 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ad20d-96ef-4f5b-bcf7-e58bc4717a20 None admin] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:05.532523 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ad20d-96ef-4f5b-bcf7-e58bc4717a20 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:05.532800 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ad20d-96ef-4f5b-bcf7-e58bc4717a20 None admin] PATH_INFO: `/v3/users` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:05.533552 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ad20d-96ef-4f5b-bcf7-e58bc4717a20 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:05.535031 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ad20d-96ef-4f5b-bcf7-e58bc4717a20 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:05.558539 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 68/141] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jul 13 23:34:05 2022] POST /identity/v3/users => generated 283 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 23:34:06.214135 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69968c-029a-4337-8278-20750c002a8c None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:06.214519 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69968c-029a-4337-8278-20750c002a8c None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:06.214695 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69968c-029a-4337-8278-20750c002a8c None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:06.217102 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 74/142] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:06.222379 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934feef-1008-44b4-8e6b-359f07a5a407 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:06.222674 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934feef-1008-44b4-8e6b-359f07a5a407 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:06.222952 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934feef-1008-44b4-8e6b-359f07a5a407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:06.249927 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-e934feef-1008-44b4-8e6b-359f07a5a407 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:06.251266 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-e934feef-1008-44b4-8e6b-359f07a5a407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:06.293830 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:06.355451 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 69/143] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:34:06.398337 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69968c-029a-4337-8278-20750c002a8c None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:06.440178 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:06.558621 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69968c-029a-4337-8278-20750c002a8c None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:06.613931 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bbfa89-0442-4b47-a0fa-39259fa02fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:06.614737 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbfa89-0442-4b47-a0fa-39259fa02fa6 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:06.615019 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbfa89-0442-4b47-a0fa-39259fa02fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:06.615360 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbfa89-0442-4b47-a0fa-39259fa02fa6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:06.633389 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bbfa89-0442-4b47-a0fa-39259fa02fa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:34:06.642595 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-c2bbfa89-0442-4b47-a0fa-39259fa02fa6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 23:34:06.642595 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:06.642595 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:06.642595 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:06.642595 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:06.642595 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:06.642595 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:06.642595 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:06.642595 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:06.642595 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:06.642595 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:06.642595 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:06.642595 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:34:06.642595 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:34:06.642595 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:34:06.642595 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:34:06.643455 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:34:06.643455 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:34:06.643455 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:34:06.643455 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:34:06.643455 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:06.643455 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:06.643455 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:06.643455 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:06.643455 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:06.643455 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:06.643455 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:06.643455 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:06.643455 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:06.643455 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:06.643455 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:06.643455 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:06.644220 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:06.644220 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:06.644220 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:06.644220 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:06.644220 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:34:06.644220 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:34:06.644220 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:34:06.644220 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:34:06.644220 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:34:06.644220 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:34:06.644220 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 23:34:06.644220 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:34:06.644220 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 75/144] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:34:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:06.649754 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934feef-1008-44b4-8e6b-359f07a5a407 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:06.763889 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c703bc-1bc0-400b-9757-1f2be2760c97 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:06.763889 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c703bc-1bc0-400b-9757-1f2be2760c97 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:06.763889 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c703bc-1bc0-400b-9757-1f2be2760c97 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:06.764481 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 76/145] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:06.770424 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934feef-1008-44b4-8e6b-359f07a5a407 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:06.773296 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833abc75-23dc-4afe-a041-a4ac637c5dac None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:06.773599 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833abc75-23dc-4afe-a041-a4ac637c5dac None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:06.773883 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833abc75-23dc-4afe-a041-a4ac637c5dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:06.806312 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-833abc75-23dc-4afe-a041-a4ac637c5dac None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:06.807444 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-833abc75-23dc-4afe-a041-a4ac637c5dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:06.822548 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dfcb6b-f9c4-458e-8c9d-fd3a8494fe99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:06.823598 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfcb6b-f9c4-458e-8c9d-fd3a8494fe99 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:06.824089 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfcb6b-f9c4-458e-8c9d-fd3a8494fe99 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:06.825142 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfcb6b-f9c4-458e-8c9d-fd3a8494fe99 None admin] PATH_INFO: `/v3/roles` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:06.826099 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dfcb6b-f9c4-458e-8c9d-fd3a8494fe99 None admin] RBAC: Adding query filter params (name=member) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:06.826732 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dfcb6b-f9c4-458e-8c9d-fd3a8494fe99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:06.828324 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dfcb6b-f9c4-458e-8c9d-fd3a8494fe99 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:06.844189 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 70/146] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 13 23:34:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:34:06.858795 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dfcb6b-f9c4-458e-8c9d-fd3a8494fe99 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:06.913462 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:06.947418 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 77/147] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 23:34:06.996553 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833abc75-23dc-4afe-a041-a4ac637c5dac None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:07.039989 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:07.042955 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dfcb6b-f9c4-458e-8c9d-fd3a8494fe99 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:07.110651 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e62c26-e021-4349-b804-28571ee3004b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:07.111899 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e62c26-e021-4349-b804-28571ee3004b None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:07.112385 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e62c26-e021-4349-b804-28571ee3004b None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:07.112905 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e62c26-e021-4349-b804-28571ee3004b None admin] PATH_INFO: `/v3/users/1db35c40e944463587194d432aaf15bb` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:07.114481 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e62c26-e021-4349-b804-28571ee3004b None admin] RBAC: Authorizing `identity:get_user(user_id=1db35c40e944463587194d432aaf15bb)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:07.116264 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e62c26-e021-4349-b804-28571ee3004b None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:07.118755 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 71/148] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 13 23:34:06 2022] GET /identity/v3/users/1db35c40e944463587194d432aaf15bb => generated 275 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:07.124775 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e62c26-e021-4349-b804-28571ee3004b None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:07.185846 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833abc75-23dc-4afe-a041-a4ac637c5dac None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:07.233564 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e347b47-cbfa-43b8-9399-15d33d7deb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:07.234348 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e347b47-cbfa-43b8-9399-15d33d7deb14 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:07.234634 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e347b47-cbfa-43b8-9399-15d33d7deb14 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:07.234900 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e347b47-cbfa-43b8-9399-15d33d7deb14 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:07.250971 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e347b47-cbfa-43b8-9399-15d33d7deb14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:34:07.267158 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-1e347b47-cbfa-43b8-9399-15d33d7deb14 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 23:34:07.267158 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:07.267158 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:07.267158 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:07.267158 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:07.267158 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:07.267158 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:07.267158 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:07.267158 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:07.267158 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:07.267158 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:07.267158 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:07.267158 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:34:07.267158 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:34:07.267158 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:34:07.267158 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:34:07.268082 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:34:07.268082 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:34:07.268082 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:34:07.268082 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:34:07.268082 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:07.268082 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:07.268082 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:07.268082 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:07.268082 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:07.268082 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:07.268082 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:07.268082 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:07.268082 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:07.268082 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:07.268082 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:07.268082 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:07.268852 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:07.268852 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:07.268852 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:07.268852 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:07.268852 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:34:07.268852 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:34:07.268852 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:34:07.268852 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:34:07.268852 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:34:07.268852 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:34:07.268852 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 23:34:07.268852 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:34:07.268852 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 78/149] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 13 23:34:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:07.275574 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e347b47-cbfa-43b8-9399-15d33d7deb14 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:07.318864 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:07.324314 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e62c26-e021-4349-b804-28571ee3004b None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:07.388092 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d266d-4a87-4da4-9b2d-fdff015eaa2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:07.388860 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d266d-4a87-4da4-9b2d-fdff015eaa2a None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:07.389101 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d266d-4a87-4da4-9b2d-fdff015eaa2a None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:07.389380 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d266d-4a87-4da4-9b2d-fdff015eaa2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:07.426724 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:07.469464 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e347b47-cbfa-43b8-9399-15d33d7deb14 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:07.543666 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5d266d-4a87-4da4-9b2d-fdff015eaa2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:07.545724 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5d266d-4a87-4da4-9b2d-fdff015eaa2a None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:07.552287 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305b40f-e10d-46af-b8a1-d99580b94058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:07.553040 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305b40f-e10d-46af-b8a1-d99580b94058 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:07.553277 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305b40f-e10d-46af-b8a1-d99580b94058 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:07.553552 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305b40f-e10d-46af-b8a1-d99580b94058 None admin] PATH_INFO: `/v3/roles` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:07.554311 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c305b40f-e10d-46af-b8a1-d99580b94058 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:07.554624 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c305b40f-e10d-46af-b8a1-d99580b94058 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:07.556000 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c305b40f-e10d-46af-b8a1-d99580b94058 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:07.577044 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 79/150] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:34:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:34:07.583438 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305b40f-e10d-46af-b8a1-d99580b94058 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:07.735482 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 72/151] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 13 23:34:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 23:34:07.735855 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:07.741687 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d266d-4a87-4da4-9b2d-fdff015eaa2a None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:07.894803 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305b40f-e10d-46af-b8a1-d99580b94058 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:07.936491 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d266d-4a87-4da4-9b2d-fdff015eaa2a None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:07.986980 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be670f-7bfa-4124-b3e0-b25c24a70d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:07.987852 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be670f-7bfa-4124-b3e0-b25c24a70d08 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:07.988156 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be670f-7bfa-4124-b3e0-b25c24a70d08 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:07.988420 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be670f-7bfa-4124-b3e0-b25c24a70d08 None admin] PATH_INFO: `/v3/users/d4a30dab8dc6492bb2bda65abda06d0d` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:07.989648 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38be670f-7bfa-4124-b3e0-b25c24a70d08 None admin] RBAC: Authorizing `identity:get_user(user_id=d4a30dab8dc6492bb2bda65abda06d0d)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:07.991108 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38be670f-7bfa-4124-b3e0-b25c24a70d08 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:07.997099 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 80/152] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 13 23:34:07 2022] GET /identity/v3/users/d4a30dab8dc6492bb2bda65abda06d0d => generated 247 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:08.001797 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be670f-7bfa-4124-b3e0-b25c24a70d08 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:08.020037 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:08.022048 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb73703-1884-487e-a199-0e2baa571350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:08.022935 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb73703-1884-487e-a199-0e2baa571350 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:08.023221 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb73703-1884-487e-a199-0e2baa571350 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:08.023498 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb73703-1884-487e-a199-0e2baa571350 None admin] PATH_INFO: `/v3/projects/815dfc6ab25b4cac9e72ec762bd3d170` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:08.029552 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb73703-1884-487e-a199-0e2baa571350 None admin] RBAC: Authorizing `identity:get_project(project_id=815dfc6ab25b4cac9e72ec762bd3d170)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:08.031593 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb73703-1884-487e-a199-0e2baa571350 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:08.033386 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 73/153] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 13 23:34:07 2022] GET /identity/v3/projects/815dfc6ab25b4cac9e72ec762bd3d170 => generated 298 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:34:08.039895 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb73703-1884-487e-a199-0e2baa571350 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:08.178921 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:08.237327 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb73703-1884-487e-a199-0e2baa571350 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:08.287038 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be670f-7bfa-4124-b3e0-b25c24a70d08 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:08.305829 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc47cf5-2fec-455d-92ac-7eb7f346fd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:08.306877 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc47cf5-2fec-455d-92ac-7eb7f346fd48 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:08.307166 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc47cf5-2fec-455d-92ac-7eb7f346fd48 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:08.307446 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc47cf5-2fec-455d-92ac-7eb7f346fd48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:08.308282 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc47cf5-2fec-455d-92ac-7eb7f346fd48 None admin] RBAC: Adding query filter params (role.id=69842edf01cf43eb814bb066f9652f48, scope.project.id=815dfc6ab25b4cac9e72ec762bd3d170, user.id=1db35c40e944463587194d432aaf15bb) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:08.308595 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc47cf5-2fec-455d-92ac-7eb7f346fd48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:08.310473 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc47cf5-2fec-455d-92ac-7eb7f346fd48 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:08.321482 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 74/154] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 13 23:34:08 2022] GET /identity/v3/role_assignments?user.id=1db35c40e944463587194d432aaf15bb&scope.project.id=815dfc6ab25b4cac9e72ec762bd3d170&role.id=69842edf01cf43eb814bb066f9652f48 => generated 608 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:08.367381 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb103b-49d5-4e76-8e6d-36c033327435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:08.368062 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb103b-49d5-4e76-8e6d-36c033327435 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:08.368346 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb103b-49d5-4e76-8e6d-36c033327435 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:08.368623 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb103b-49d5-4e76-8e6d-36c033327435 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:08.461376 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb103b-49d5-4e76-8e6d-36c033327435 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:08.462905 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb103b-49d5-4e76-8e6d-36c033327435 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:08.480810 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:08.549328 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea0374-1c3c-4c2d-a1b9-4ae658d79975 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:08.549830 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea0374-1c3c-4c2d-a1b9-4ae658d79975 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:08.549926 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea0374-1c3c-4c2d-a1b9-4ae658d79975 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:08.553042 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 75/155] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:08.565318 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221391d3-2970-4c46-8493-c4d34d287e58 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:08.565729 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221391d3-2970-4c46-8493-c4d34d287e58 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:08.566012 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221391d3-2970-4c46-8493-c4d34d287e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:08.597415 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-221391d3-2970-4c46-8493-c4d34d287e58 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:08.598758 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-221391d3-2970-4c46-8493-c4d34d287e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:08.618229 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 81/156] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 13 23:34:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 23:34:08.626001 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb103b-49d5-4e76-8e6d-36c033327435 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:08.738590 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 76/157] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 23:34:08.766256 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221391d3-2970-4c46-8493-c4d34d287e58 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:08.830082 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb103b-49d5-4e76-8e6d-36c033327435 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:08.850425 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:08.877801 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:08.912387 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86b898-c0e5-4885-9312-837deccca892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:08.913288 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86b898-c0e5-4885-9312-837deccca892 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:08.913570 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86b898-c0e5-4885-9312-837deccca892 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:08.913855 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86b898-c0e5-4885-9312-837deccca892 None admin] PATH_INFO: `/v3/projects/815dfc6ab25b4cac9e72ec762bd3d170` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:08.915919 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c86b898-c0e5-4885-9312-837deccca892 None admin] RBAC: Authorizing `identity:get_project(project_id=815dfc6ab25b4cac9e72ec762bd3d170)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:08.917403 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c86b898-c0e5-4885-9312-837deccca892 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:08.919797 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 82/158] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 13 23:34:08 2022] GET /identity/v3/projects/815dfc6ab25b4cac9e72ec762bd3d170 => generated 298 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:34:08.921044 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79234374-0dee-4fff-9fa1-cff09f5c77de None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:08.921330 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79234374-0dee-4fff-9fa1-cff09f5c77de None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:08.921607 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79234374-0dee-4fff-9fa1-cff09f5c77de None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:08.922820 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 83/159] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:08.927569 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79234374-0dee-4fff-9fa1-cff09f5c77de None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:08.947296 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221391d3-2970-4c46-8493-c4d34d287e58 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:08.987428 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125d22e-113a-44a2-80bd-279fd7ac2ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:08.988229 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125d22e-113a-44a2-80bd-279fd7ac2ad6 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:08.988509 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125d22e-113a-44a2-80bd-279fd7ac2ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:08.988779 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125d22e-113a-44a2-80bd-279fd7ac2ad6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:09.003467 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5125d22e-113a-44a2-80bd-279fd7ac2ad6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:34:09.019542 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-5125d22e-113a-44a2-80bd-279fd7ac2ad6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 23:34:09.019542 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:09.019542 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:09.019542 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:09.019542 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:09.019542 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:09.019542 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:09.019542 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:09.019542 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:09.019542 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:09.019542 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:09.019542 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:09.019542 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:34:09.019542 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:34:09.019542 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:34:09.019542 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:34:09.020511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:34:09.020511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:34:09.020511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:34:09.020511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:34:09.020511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:09.020511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:09.020511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:09.020511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:09.020511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:09.020511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:09.020511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:09.020511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:09.020511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:09.020511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:09.020511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:09.020511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:09.021321 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:09.021321 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:09.021321 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:09.021321 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:09.021321 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:34:09.021321 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:34:09.021321 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:34:09.021321 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:34:09.021321 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:34:09.021321 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:34:09.021321 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 23:34:09.021321 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:34:09.021321 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 77/160] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:34:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 23:34:09.022461 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f30703-80f5-4ae8-8135-50d3cc614431 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:09.024062 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f30703-80f5-4ae8-8135-50d3cc614431 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:09.024062 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f30703-80f5-4ae8-8135-50d3cc614431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:09.044411 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-07f30703-80f5-4ae8-8135-50d3cc614431 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:09.046129 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-07f30703-80f5-4ae8-8135-50d3cc614431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:09.137031 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 78/161] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:34:09.138158 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f30703-80f5-4ae8-8135-50d3cc614431 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:09.209454 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:09.245651 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79234374-0dee-4fff-9fa1-cff09f5c77de None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:09.276386 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f30703-80f5-4ae8-8135-50d3cc614431 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:09.341600 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2c850-3e7f-4043-9116-601232ee9688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:09.342275 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2c850-3e7f-4043-9116-601232ee9688 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:09.342446 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a294f-0e06-48d6-9da6-cf69ba224aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:09.342567 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2c850-3e7f-4043-9116-601232ee9688 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:09.342819 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2c850-3e7f-4043-9116-601232ee9688 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:09.343138 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a294f-0e06-48d6-9da6-cf69ba224aa0 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:09.343422 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a294f-0e06-48d6-9da6-cf69ba224aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:09.343666 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2c850-3e7f-4043-9116-601232ee9688 None admin] RBAC: Adding query filter params (role.id=46deff0e06964626a5600c9641454603, scope.project.id=815dfc6ab25b4cac9e72ec762bd3d170, user.id=d4a30dab8dc6492bb2bda65abda06d0d) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:09.343769 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a294f-0e06-48d6-9da6-cf69ba224aa0 None admin] PATH_INFO: `/v3/roles` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:09.343976 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2c850-3e7f-4043-9116-601232ee9688 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:09.344419 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1a294f-0e06-48d6-9da6-cf69ba224aa0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:09.344725 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1a294f-0e06-48d6-9da6-cf69ba224aa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:09.345476 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2c850-3e7f-4043-9116-601232ee9688 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:09.346117 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1a294f-0e06-48d6-9da6-cf69ba224aa0 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:09.358319 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 84/162] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 13 23:34:08 2022] GET /identity/v3/role_assignments?user.id=d4a30dab8dc6492bb2bda65abda06d0d&scope.project.id=815dfc6ab25b4cac9e72ec762bd3d170&role.id=46deff0e06964626a5600c9641454603 => generated 608 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:34:09.359001 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2c850-3e7f-4043-9116-601232ee9688 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:09.364896 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 79/163] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 13 23:34:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:09.366097 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354df84-d137-4116-8995-683af405010a None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:09.366386 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354df84-d137-4116-8995-683af405010a None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:09.366665 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354df84-d137-4116-8995-683af405010a None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:09.368160 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 80/164] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:09.383076 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354df84-d137-4116-8995-683af405010a None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:09.468989 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:09.589624 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2c850-3e7f-4043-9116-601232ee9688 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:09.635273 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354df84-d137-4116-8995-683af405010a None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:09.672616 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37fd256-93fd-4b79-8fee-d768aa14a474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:09.673962 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37fd256-93fd-4b79-8fee-d768aa14a474 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:09.673962 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37fd256-93fd-4b79-8fee-d768aa14a474 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:09.673962 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37fd256-93fd-4b79-8fee-d768aa14a474 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:09.687577 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3397ff57-fa7b-43a2-a004-4da89d6577da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:09.688901 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397ff57-fa7b-43a2-a004-4da89d6577da None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:09.689349 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397ff57-fa7b-43a2-a004-4da89d6577da None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:09.689756 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397ff57-fa7b-43a2-a004-4da89d6577da None admin] PATH_INFO: `/v3/users/2b4b23446cd74e6a9b2fbfa174be84a9` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:09.691310 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37fd256-93fd-4b79-8fee-d768aa14a474 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:34:09.691493 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3397ff57-fa7b-43a2-a004-4da89d6577da None admin] RBAC: Authorizing `identity:get_user(user_id=2b4b23446cd74e6a9b2fbfa174be84a9)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:09.693117 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3397ff57-fa7b-43a2-a004-4da89d6577da None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:09.695317 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 81/165] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 13 23:34:09 2022] GET /identity/v3/users/2b4b23446cd74e6a9b2fbfa174be84a9 => generated 289 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:09.695667 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:09.697191 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc591d-3242-4dd4-b737-63880158379c None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:09.697670 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc591d-3242-4dd4-b737-63880158379c None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:09.698067 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc591d-3242-4dd4-b737-63880158379c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:09.712876 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-d37fd256-93fd-4b79-8fee-d768aa14a474 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 23:34:09.712876 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:09.712876 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:09.712876 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:09.712876 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:09.712876 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:09.712876 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:09.712876 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:09.712876 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:09.712876 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:09.712876 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:09.712876 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:09.712876 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:34:09.712876 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:34:09.712876 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:34:09.712876 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:34:09.713909 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:34:09.713909 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:34:09.713909 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:34:09.713909 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:34:09.713909 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:09.713909 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:09.713909 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:09.713909 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:09.713909 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:09.713909 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:09.713909 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:09.713909 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:09.713909 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:09.713909 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:09.713909 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:09.713909 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:09.714951 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:09.714951 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:09.714951 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:09.714951 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:09.714951 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:34:09.714951 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:34:09.714951 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:34:09.714951 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:34:09.714951 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:34:09.714951 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:34:09.714951 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 23:34:09.714951 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:34:09.719691 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-6bbc591d-3242-4dd4-b737-63880158379c None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:09.721092 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-6bbc591d-3242-4dd4-b737-63880158379c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:09.722616 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 85/166] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jul 13 23:34:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:09.723602 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37fd256-93fd-4b79-8fee-d768aa14a474 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:09.829242 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 82/167] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:34:09.831469 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc591d-3242-4dd4-b737-63880158379c None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:09.837247 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37fd256-93fd-4b79-8fee-d768aa14a474 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:09.838869 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:09.880308 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f702f9f-c452-4e4a-b798-0a0fde1bbd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:09.881508 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f702f9f-c452-4e4a-b798-0a0fde1bbd24 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:09.881666 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f702f9f-c452-4e4a-b798-0a0fde1bbd24 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:09.882042 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f702f9f-c452-4e4a-b798-0a0fde1bbd24 None admin] PATH_INFO: `/v3/projects/815dfc6ab25b4cac9e72ec762bd3d170` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:09.885896 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f702f9f-c452-4e4a-b798-0a0fde1bbd24 None admin] RBAC: Authorizing `identity:get_project(project_id=815dfc6ab25b4cac9e72ec762bd3d170)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:09.888260 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f702f9f-c452-4e4a-b798-0a0fde1bbd24 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:09.890037 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 86/168] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 13 23:34:09 2022] GET /identity/v3/projects/815dfc6ab25b4cac9e72ec762bd3d170 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:09.890811 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f702f9f-c452-4e4a-b798-0a0fde1bbd24 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:10.025212 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc591d-3242-4dd4-b737-63880158379c None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:10.049179 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:10.079960 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f702f9f-c452-4e4a-b798-0a0fde1bbd24 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:10.115211 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d9c01-f938-4714-9026-fda528db235e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:10.116022 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d9c01-f938-4714-9026-fda528db235e None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:10.116310 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d9c01-f938-4714-9026-fda528db235e None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:10.116587 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d9c01-f938-4714-9026-fda528db235e None admin] PATH_INFO: `/v3/roles/member` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:10.122060 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f581ee-268c-49bb-b04b-9a0a30f4c648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:10.122747 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f581ee-268c-49bb-b04b-9a0a30f4c648 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:10.123031 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f581ee-268c-49bb-b04b-9a0a30f4c648 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:10.123345 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f581ee-268c-49bb-b04b-9a0a30f4c648 None admin] PATH_INFO: `/v3/roles` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:10.124047 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f581ee-268c-49bb-b04b-9a0a30f4c648 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:10.124356 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f581ee-268c-49bb-b04b-9a0a30f4c648 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:10.125888 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f581ee-268c-49bb-b04b-9a0a30f4c648 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:10.128447 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d9c01-f938-4714-9026-fda528db235e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:34:10.136232 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-ea0d9c01-f938-4714-9026-fda528db235e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 23:34:10.136232 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:10.136232 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:10.136232 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:10.136232 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:10.136232 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:10.136232 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:10.136232 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:10.136232 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:10.136232 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:10.136232 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:10.136232 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:10.136232 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:34:10.136232 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:34:10.136232 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:34:10.136232 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:34:10.137273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:34:10.137273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:34:10.137273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:34:10.137273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:34:10.137273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:10.137273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:10.137273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:10.137273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:10.137273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:10.137273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:10.137273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:10.137273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:10.137273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:10.137273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:10.137273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:10.137273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:10.138863 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:10.138863 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:10.138863 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:10.138863 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:10.138863 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:34:10.138863 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:34:10.138863 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:34:10.138863 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:34:10.138863 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:34:10.138863 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:34:10.138863 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 23:34:10.138863 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:34:10.138863 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 87/169] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:34:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:10.138863 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d9c01-f938-4714-9026-fda528db235e None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:10.145524 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 83/170] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 13 23:34:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:10.146410 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f581ee-268c-49bb-b04b-9a0a30f4c648 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:10.173408 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:10.246719 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d9c01-f938-4714-9026-fda528db235e None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:10.300535 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5328d31-2986-4d47-8a6d-b8c4c4f00135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:10.301388 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5328d31-2986-4d47-8a6d-b8c4c4f00135 None admin] REQUEST_METHOD: `PUT` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:10.301677 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5328d31-2986-4d47-8a6d-b8c4c4f00135 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:10.301958 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5328d31-2986-4d47-8a6d-b8c4c4f00135 None admin] PATH_INFO: `/v3/projects/815dfc6ab25b4cac9e72ec762bd3d170/users/2b4b23446cd74e6a9b2fbfa174be84a9/roles/ef94ce01ebc74f67b71913824c20fbe4` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:10.307508 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5328d31-2986-4d47-8a6d-b8c4c4f00135 None admin] RBAC: Authorizing `identity:create_grant(project_id=815dfc6ab25b4cac9e72ec762bd3d170, user_id=2b4b23446cd74e6a9b2fbfa174be84a9, role_id=ef94ce01ebc74f67b71913824c20fbe4)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:10.309540 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5328d31-2986-4d47-8a6d-b8c4c4f00135 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:10.335116 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 88/171] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jul 13 23:34:10 2022] PUT /identity/v3/projects/815dfc6ab25b4cac9e72ec762bd3d170/users/2b4b23446cd74e6a9b2fbfa174be84a9/roles/ef94ce01ebc74f67b71913824c20fbe4 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 23:34:10.336948 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5328d31-2986-4d47-8a6d-b8c4c4f00135 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:10.409440 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f581ee-268c-49bb-b04b-9a0a30f4c648 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:10.499400 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:10.510075 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5328d31-2986-4d47-8a6d-b8c4c4f00135 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:10.521612 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e22e51-c20b-42bd-ad4b-3e747e00dd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:10.522337 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e22e51-c20b-42bd-ad4b-3e747e00dd13 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:10.522628 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e22e51-c20b-42bd-ad4b-3e747e00dd13 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:10.522908 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e22e51-c20b-42bd-ad4b-3e747e00dd13 None admin] PATH_INFO: `/v3/roles` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:10.523688 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e22e51-c20b-42bd-ad4b-3e747e00dd13 None admin] RBAC: Adding query filter params (name=member) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:10.524002 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e22e51-c20b-42bd-ad4b-3e747e00dd13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:10.525507 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e22e51-c20b-42bd-ad4b-3e747e00dd13 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:10.548859 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 84/172] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 13 23:34:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:10.550296 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46396cc0-a416-4d5f-95a7-bc58c1481080 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:10.553144 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46396cc0-a416-4d5f-95a7-bc58c1481080 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:10.553381 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46396cc0-a416-4d5f-95a7-bc58c1481080 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:10.555003 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 85/173] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:10.555542 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46396cc0-a416-4d5f-95a7-bc58c1481080 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:10.606277 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c979d53-3cb5-49c9-aa91-e79250f152ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:10.607178 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c979d53-3cb5-49c9-aa91-e79250f152ad None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:10.607467 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c979d53-3cb5-49c9-aa91-e79250f152ad None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:10.607762 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c979d53-3cb5-49c9-aa91-e79250f152ad None admin] PATH_INFO: `/v3/users/1db35c40e944463587194d432aaf15bb` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:10.610391 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:10.611595 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c979d53-3cb5-49c9-aa91-e79250f152ad None admin] RBAC: Authorizing `identity:get_user(user_id=1db35c40e944463587194d432aaf15bb)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:10.613261 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c979d53-3cb5-49c9-aa91-e79250f152ad None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:10.615122 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 89/174] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 13 23:34:10 2022] GET /identity/v3/users/1db35c40e944463587194d432aaf15bb => generated 275 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:10.616515 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a7d0d-f63f-400a-90fb-a45792e3daab None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:10.617116 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a7d0d-f63f-400a-90fb-a45792e3daab None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:10.617587 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a7d0d-f63f-400a-90fb-a45792e3daab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:10.640924 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-2c4a7d0d-f63f-400a-90fb-a45792e3daab None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:10.642354 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-2c4a7d0d-f63f-400a-90fb-a45792e3daab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:10.691981 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46396cc0-a416-4d5f-95a7-bc58c1481080 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:10.721781 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 90/175] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:34:10.722549 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a7d0d-f63f-400a-90fb-a45792e3daab None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:10.735917 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f7679-6ab7-43bc-a312-e16a07ea4998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:10.736811 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f7679-6ab7-43bc-a312-e16a07ea4998 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:10.737132 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f7679-6ab7-43bc-a312-e16a07ea4998 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:10.737410 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f7679-6ab7-43bc-a312-e16a07ea4998 None admin] PATH_INFO: `/v3/users/1db35c40e944463587194d432aaf15bb` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:10.738625 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08f7679-6ab7-43bc-a312-e16a07ea4998 None admin] RBAC: Authorizing `identity:get_user(user_id=1db35c40e944463587194d432aaf15bb)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:10.740527 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08f7679-6ab7-43bc-a312-e16a07ea4998 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:10.742192 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 86/176] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 13 23:34:10 2022] GET /identity/v3/users/1db35c40e944463587194d432aaf15bb => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:10.743365 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e2855-0404-40dd-b9ba-8cf9a6f985e4 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:10.743650 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e2855-0404-40dd-b9ba-8cf9a6f985e4 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:10.743929 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e2855-0404-40dd-b9ba-8cf9a6f985e4 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:10.745791 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 87/177] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:10.753633 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12be00-5bca-4e39-9b89-087ae6bfd313 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:10.754097 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12be00-5bca-4e39-9b89-087ae6bfd313 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:10.754540 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12be00-5bca-4e39-9b89-087ae6bfd313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:10.776410 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-4f12be00-5bca-4e39-9b89-087ae6bfd313 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:10.779043 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-4f12be00-5bca-4e39-9b89-087ae6bfd313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:10.846549 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:10.860908 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a7d0d-f63f-400a-90fb-a45792e3daab None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:10.863744 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 88/178] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:34:10.864932 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12be00-5bca-4e39-9b89-087ae6bfd313 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:10.905266 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:10.928419 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a67a04f-170d-4ca7-92b3-e4a864b5d75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:10.929133 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67a04f-170d-4ca7-92b3-e4a864b5d75f None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:10.929421 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67a04f-170d-4ca7-92b3-e4a864b5d75f None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:10.929696 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67a04f-170d-4ca7-92b3-e4a864b5d75f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:10.985911 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12be00-5bca-4e39-9b89-087ae6bfd313 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:11.001118 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a67a04f-170d-4ca7-92b3-e4a864b5d75f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:11.002714 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a67a04f-170d-4ca7-92b3-e4a864b5d75f None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:11.025814 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2180b-2305-4e2b-a413-aec0349f58fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:11.026524 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2180b-2305-4e2b-a413-aec0349f58fe None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:11.026755 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2180b-2305-4e2b-a413-aec0349f58fe None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:11.027035 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2180b-2305-4e2b-a413-aec0349f58fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:11.094745 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:11.103429 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2180b-2305-4e2b-a413-aec0349f58fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:11.104853 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2180b-2305-4e2b-a413-aec0349f58fe None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:11.110930 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 91/179] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 13 23:34:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 23:34:11.111911 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a67a04f-170d-4ca7-92b3-e4a864b5d75f None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:11.139235 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:11.213942 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 89/180] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 13 23:34:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 23:34:11.215092 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2180b-2305-4e2b-a413-aec0349f58fe None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:11.226776 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a67a04f-170d-4ca7-92b3-e4a864b5d75f None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:11.264274 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e0966f-0641-4f88-aa86-fbfe5766a441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:11.265115 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0966f-0641-4f88-aa86-fbfe5766a441 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:11.265401 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0966f-0641-4f88-aa86-fbfe5766a441 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:11.265678 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0966f-0641-4f88-aa86-fbfe5766a441 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:11.276371 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e0966f-0641-4f88-aa86-fbfe5766a441 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:34:11.284908 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-b0e0966f-0641-4f88-aa86-fbfe5766a441 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 23:34:11.284908 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:11.284908 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:11.284908 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:11.284908 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:11.284908 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:11.284908 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:11.284908 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:11.284908 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:11.284908 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:11.284908 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:11.284908 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:11.284908 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:34:11.284908 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:34:11.284908 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:34:11.284908 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:34:11.285803 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:34:11.285803 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:34:11.285803 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:34:11.285803 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:34:11.285803 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:11.285803 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:11.285803 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:11.285803 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:11.285803 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:11.285803 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:11.285803 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:11.285803 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:11.285803 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:11.285803 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:11.285803 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:11.285803 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:11.286565 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:11.286565 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:11.286565 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:11.286565 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:11.286565 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:34:11.286565 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:34:11.286565 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:34:11.286565 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:34:11.286565 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:34:11.286565 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:34:11.286565 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 23:34:11.286565 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:34:11.287800 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 92/181] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 13 23:34:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:11.289018 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb66ce9-92ca-4d21-a9c2-be5cb1ebd4cd None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:11.289307 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb66ce9-92ca-4d21-a9c2-be5cb1ebd4cd None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:11.289585 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb66ce9-92ca-4d21-a9c2-be5cb1ebd4cd None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:11.296871 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 93/182] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:11.296871 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb66ce9-92ca-4d21-a9c2-be5cb1ebd4cd None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:11.333078 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2180b-2305-4e2b-a413-aec0349f58fe None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:11.351739 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:11.366600 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:11.374421 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33336e-a813-43c1-ab08-2f576256f626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:11.375369 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33336e-a813-43c1-ab08-2f576256f626 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:11.376439 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33336e-a813-43c1-ab08-2f576256f626 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:11.376725 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33336e-a813-43c1-ab08-2f576256f626 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:11.377942 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d33336e-a813-43c1-ab08-2f576256f626 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:11.379389 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d33336e-a813-43c1-ab08-2f576256f626 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:11.385794 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 90/183] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:34:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:11.385794 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33336e-a813-43c1-ab08-2f576256f626 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:11.408143 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb66ce9-92ca-4d21-a9c2-be5cb1ebd4cd None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:11.444905 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8f253-2778-4a6f-a0e3-4f8f649ae4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:11.445767 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8f253-2778-4a6f-a0e3-4f8f649ae4a1 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:11.446054 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8f253-2778-4a6f-a0e3-4f8f649ae4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:11.446332 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8f253-2778-4a6f-a0e3-4f8f649ae4a1 None admin] PATH_INFO: `/v3/projects/815dfc6ab25b4cac9e72ec762bd3d170` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:11.447508 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab8f253-2778-4a6f-a0e3-4f8f649ae4a1 None admin] RBAC: Authorizing `identity:get_project(project_id=815dfc6ab25b4cac9e72ec762bd3d170)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:11.448967 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab8f253-2778-4a6f-a0e3-4f8f649ae4a1 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:11.455775 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 94/184] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 13 23:34:11 2022] GET /identity/v3/projects/815dfc6ab25b4cac9e72ec762bd3d170 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:11.455775 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8f253-2778-4a6f-a0e3-4f8f649ae4a1 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:11.496426 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33336e-a813-43c1-ab08-2f576256f626 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:11.541925 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bcc01f-3173-4442-b405-1c5e7f62a3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:11.543041 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcc01f-3173-4442-b405-1c5e7f62a3a5 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:11.543788 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcc01f-3173-4442-b405-1c5e7f62a3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:11.544076 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcc01f-3173-4442-b405-1c5e7f62a3a5 None admin] PATH_INFO: `/v3/projects/f254fe9b74f645758190ac34ac45b8be` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:11.545322 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bcc01f-3173-4442-b405-1c5e7f62a3a5 None admin] RBAC: Authorizing `identity:get_project(project_id=f254fe9b74f645758190ac34ac45b8be)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:11.546769 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bcc01f-3173-4442-b405-1c5e7f62a3a5 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:11.548640 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 91/185] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 13 23:34:11 2022] GET /identity/v3/projects/f254fe9b74f645758190ac34ac45b8be => generated 312 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:11.554849 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899feb98-b119-4054-88e4-e37946589482 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:11.555132 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899feb98-b119-4054-88e4-e37946589482 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:11.555407 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899feb98-b119-4054-88e4-e37946589482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:11.565437 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8f253-2778-4a6f-a0e3-4f8f649ae4a1 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:11.573629 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-899feb98-b119-4054-88e4-e37946589482 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:11.575670 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-899feb98-b119-4054-88e4-e37946589482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:11.584533 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:11.606812 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8500e1-1e6c-4f22-8876-471a1839f01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:11.607913 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8500e1-1e6c-4f22-8876-471a1839f01d None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:11.608199 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8500e1-1e6c-4f22-8876-471a1839f01d None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:11.608472 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8500e1-1e6c-4f22-8876-471a1839f01d None admin] PATH_INFO: `/v3/roles` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:11.609246 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8500e1-1e6c-4f22-8876-471a1839f01d None admin] RBAC: Adding query filter params (name=admin) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:11.609558 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8500e1-1e6c-4f22-8876-471a1839f01d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:11.611738 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8500e1-1e6c-4f22-8876-471a1839f01d None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:11.626058 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 95/186] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:34:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:11.626058 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8500e1-1e6c-4f22-8876-471a1839f01d None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:11.654488 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:11.660645 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 92/187] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:34:11.670285 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899feb98-b119-4054-88e4-e37946589482 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:11.745769 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8500e1-1e6c-4f22-8876-471a1839f01d None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:11.782486 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce6ce99-1bef-48e9-ae30-e4a1bca84c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:11.783154 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6ce99-1bef-48e9-ae30-e4a1bca84c43 None admin] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:11.783442 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6ce99-1bef-48e9-ae30-e4a1bca84c43 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:11.783722 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6ce99-1bef-48e9-ae30-e4a1bca84c43 None admin] PATH_INFO: `/v3/users` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:11.784428 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce6ce99-1bef-48e9-ae30-e4a1bca84c43 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:11.785938 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce6ce99-1bef-48e9-ae30-e4a1bca84c43 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:11.788149 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899feb98-b119-4054-88e4-e37946589482 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:11.808402 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 96/188] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jul 13 23:34:11 2022] POST /identity/v3/users => generated 297 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 23:34:11.810249 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce6ce99-1bef-48e9-ae30-e4a1bca84c43 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:11.828714 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5de4ff-198f-4b61-a075-aa251967e082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:11.829440 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5de4ff-198f-4b61-a075-aa251967e082 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:11.829725 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5de4ff-198f-4b61-a075-aa251967e082 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:11.829999 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5de4ff-198f-4b61-a075-aa251967e082 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:11.830850 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5de4ff-198f-4b61-a075-aa251967e082 None admin] RBAC: Adding query filter params (role.id=a27ce0a47b0a4f9bac8c6e78d9da4278, scope.project.id=815dfc6ab25b4cac9e72ec762bd3d170, user.id=1db35c40e944463587194d432aaf15bb) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:11.831163 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5de4ff-198f-4b61-a075-aa251967e082 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:11.832667 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5de4ff-198f-4b61-a075-aa251967e082 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:11.842757 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 93/189] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 13 23:34:11 2022] GET /identity/v3/role_assignments?user.id=1db35c40e944463587194d432aaf15bb&scope.project.id=815dfc6ab25b4cac9e72ec762bd3d170&role.id=a27ce0a47b0a4f9bac8c6e78d9da4278 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:11.845947 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5de4ff-198f-4b61-a075-aa251967e082 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:11.920344 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:11.938068 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:12.019083 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5de4ff-198f-4b61-a075-aa251967e082 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:12.045642 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce6ce99-1bef-48e9-ae30-e4a1bca84c43 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:12.059755 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6aab4-55e8-4f76-a102-ab7d94a68b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:12.060765 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6aab4-55e8-4f76-a102-ab7d94a68b51 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:12.061146 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6aab4-55e8-4f76-a102-ab7d94a68b51 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:12.061366 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6aab4-55e8-4f76-a102-ab7d94a68b51 None admin] PATH_INFO: `/v3/users/4c6d5ebdee734763b519a59b5c6c836f` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:12.080037 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd6aab4-55e8-4f76-a102-ab7d94a68b51 None admin] RBAC: Authorizing `identity:get_user(user_id=4c6d5ebdee734763b519a59b5c6c836f)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:12.081356 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd6aab4-55e8-4f76-a102-ab7d94a68b51 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:12.083533 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 94/190] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 13 23:34:11 2022] GET /identity/v3/users/4c6d5ebdee734763b519a59b5c6c836f => generated 283 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:12.084157 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6aab4-55e8-4f76-a102-ab7d94a68b51 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:12.092213 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401c454-841a-42ff-a626-5affedd347dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:12.093302 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401c454-841a-42ff-a626-5affedd347dc None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:12.093764 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401c454-841a-42ff-a626-5affedd347dc None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:12.094241 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401c454-841a-42ff-a626-5affedd347dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:12.095297 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401c454-841a-42ff-a626-5affedd347dc None admin] RBAC: Adding query filter params (role.id=69842edf01cf43eb814bb066f9652f48, scope.project.id=f254fe9b74f645758190ac34ac45b8be, user.id=1db35c40e944463587194d432aaf15bb) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:12.095788 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401c454-841a-42ff-a626-5affedd347dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:12.097496 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401c454-841a-42ff-a626-5affedd347dc None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:12.104422 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 97/191] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 13 23:34:11 2022] GET /identity/v3/role_assignments?user.id=1db35c40e944463587194d432aaf15bb&scope.project.id=f254fe9b74f645758190ac34ac45b8be&role.id=69842edf01cf43eb814bb066f9652f48 => generated 608 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:12.106630 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401c454-841a-42ff-a626-5affedd347dc None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:12.228853 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6aab4-55e8-4f76-a102-ab7d94a68b51 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:12.253127 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:12.257120 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:12.257683 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401c454-841a-42ff-a626-5affedd347dc None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:12.276067 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dcc455-34a3-475d-b2f5-4a17bc4dc1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:12.277018 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dcc455-34a3-475d-b2f5-4a17bc4dc1ca None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:12.277844 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dcc455-34a3-475d-b2f5-4a17bc4dc1ca None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:12.278150 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dcc455-34a3-475d-b2f5-4a17bc4dc1ca None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:12.299997 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dcc455-34a3-475d-b2f5-4a17bc4dc1ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:34:12.308647 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-b3dcc455-34a3-475d-b2f5-4a17bc4dc1ca None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 23:34:12.308647 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:12.308647 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:12.308647 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:12.308647 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:12.308647 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:12.308647 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:12.308647 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:12.308647 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:12.308647 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:12.308647 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:12.308647 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:12.308647 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:34:12.308647 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:34:12.308647 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:34:12.308647 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:34:12.309663 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:34:12.309663 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:34:12.309663 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:34:12.309663 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:34:12.309663 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:12.309663 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:12.309663 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:12.309663 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:12.309663 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:12.309663 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:12.309663 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:12.309663 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:12.309663 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:12.309663 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:12.309663 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:12.309663 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:12.310442 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:12.310442 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:12.310442 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:12.310442 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:12.310442 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:34:12.310442 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:34:12.310442 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:34:12.310442 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:34:12.310442 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:34:12.310442 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:34:12.310442 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 23:34:12.310442 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:34:12.310442 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 95/192] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jul 13 23:34:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:12.314905 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b07b1-709f-457b-8b8b-c1b7cc1b2382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:12.315636 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b07b1-709f-457b-8b8b-c1b7cc1b2382 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:12.315927 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b07b1-709f-457b-8b8b-c1b7cc1b2382 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:12.316208 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b07b1-709f-457b-8b8b-c1b7cc1b2382 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:12.319243 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dcc455-34a3-475d-b2f5-4a17bc4dc1ca None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:12.423389 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95b07b1-709f-457b-8b8b-c1b7cc1b2382 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:12.425009 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95b07b1-709f-457b-8b8b-c1b7cc1b2382 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:12.436479 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dcc455-34a3-475d-b2f5-4a17bc4dc1ca None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:12.474301 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d4f179-351f-47cc-92f0-da655e217686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:12.474987 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4f179-351f-47cc-92f0-da655e217686 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:12.475278 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4f179-351f-47cc-92f0-da655e217686 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:12.475557 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4f179-351f-47cc-92f0-da655e217686 None admin] PATH_INFO: `/v3/roles` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:12.476305 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d4f179-351f-47cc-92f0-da655e217686 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:12.476613 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d4f179-351f-47cc-92f0-da655e217686 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:12.478008 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d4f179-351f-47cc-92f0-da655e217686 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:12.487320 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 96/193] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 13 23:34:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:12.492985 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d4f179-351f-47cc-92f0-da655e217686 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:12.554092 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:12.561325 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 98/194] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 13 23:34:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 23:34:12.564959 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:12.569203 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b07b1-709f-457b-8b8b-c1b7cc1b2382 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:12.642929 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d4f179-351f-47cc-92f0-da655e217686 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:12.681557 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3a908-22ec-48d8-b735-6c869484bbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:12.682833 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3a908-22ec-48d8-b735-6c869484bbff None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:12.683384 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3a908-22ec-48d8-b735-6c869484bbff None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:12.684093 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3a908-22ec-48d8-b735-6c869484bbff None admin] PATH_INFO: `/v3/users/4c6d5ebdee734763b519a59b5c6c836f` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:12.684364 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b07b1-709f-457b-8b8b-c1b7cc1b2382 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:12.685745 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3a908-22ec-48d8-b735-6c869484bbff None admin] RBAC: Authorizing `identity:get_user(user_id=4c6d5ebdee734763b519a59b5c6c836f)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:12.687656 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3a908-22ec-48d8-b735-6c869484bbff None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:12.694177 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 97/195] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 13 23:34:12 2022] GET /identity/v3/users/4c6d5ebdee734763b519a59b5c6c836f => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:12.695638 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3a908-22ec-48d8-b735-6c869484bbff None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:12.721609 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e297c-b83e-44fb-bcb2-37ffc73175d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:12.722482 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e297c-b83e-44fb-bcb2-37ffc73175d0 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:12.722765 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e297c-b83e-44fb-bcb2-37ffc73175d0 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:12.723046 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e297c-b83e-44fb-bcb2-37ffc73175d0 None admin] PATH_INFO: `/v3/projects/b360f1c130384ed8a57179e36d9b4f7d` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:12.724351 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78e297c-b83e-44fb-bcb2-37ffc73175d0 None admin] RBAC: Authorizing `identity:get_project(project_id=b360f1c130384ed8a57179e36d9b4f7d)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:12.731180 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78e297c-b83e-44fb-bcb2-37ffc73175d0 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:12.733272 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 99/196] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 13 23:34:12 2022] GET /identity/v3/projects/b360f1c130384ed8a57179e36d9b4f7d => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:12.739027 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e297c-b83e-44fb-bcb2-37ffc73175d0 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:12.820141 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3a908-22ec-48d8-b735-6c869484bbff None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:12.833517 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:12.859639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac00ed-280d-4ebc-a458-02ffcc892250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:12.860651 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac00ed-280d-4ebc-a458-02ffcc892250 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:12.861182 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac00ed-280d-4ebc-a458-02ffcc892250 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:12.861651 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac00ed-280d-4ebc-a458-02ffcc892250 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:12.871804 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:12.938812 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac00ed-280d-4ebc-a458-02ffcc892250 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:12.942226 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac00ed-280d-4ebc-a458-02ffcc892250 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:12.959104 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e297c-b83e-44fb-bcb2-37ffc73175d0 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:13.017388 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97677bca-ebd1-4b0e-aa81-1eb8d2d58b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:13.018444 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97677bca-ebd1-4b0e-aa81-1eb8d2d58b9c None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:13.018879 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97677bca-ebd1-4b0e-aa81-1eb8d2d58b9c None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:13.019111 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97677bca-ebd1-4b0e-aa81-1eb8d2d58b9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:13.020021 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97677bca-ebd1-4b0e-aa81-1eb8d2d58b9c None admin] RBAC: Adding query filter params (role.id=46deff0e06964626a5600c9641454603, scope.project.id=b360f1c130384ed8a57179e36d9b4f7d, user.id=4c6d5ebdee734763b519a59b5c6c836f) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:13.020403 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97677bca-ebd1-4b0e-aa81-1eb8d2d58b9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:13.021969 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97677bca-ebd1-4b0e-aa81-1eb8d2d58b9c None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:13.036987 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 100/197] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 13 23:34:12 2022] GET /identity/v3/role_assignments?user.id=4c6d5ebdee734763b519a59b5c6c836f&scope.project.id=b360f1c130384ed8a57179e36d9b4f7d&role.id=46deff0e06964626a5600c9641454603 => generated 259 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:34:13.115455 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 98/198] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 13 23:34:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 13 23:34:13.122503 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97677bca-ebd1-4b0e-aa81-1eb8d2d58b9c None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:13.237251 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21eff42-93de-4931-85a2-a75615f7b9a9 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:13.237888 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21eff42-93de-4931-85a2-a75615f7b9a9 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:13.238282 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21eff42-93de-4931-85a2-a75615f7b9a9 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:13.241104 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 99/199] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 23:34:13.245517 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fddf47-4fd8-4ea1-ae0f-eb9a5c721a5b None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:13.245921 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fddf47-4fd8-4ea1-ae0f-eb9a5c721a5b None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:13.246970 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fddf47-4fd8-4ea1-ae0f-eb9a5c721a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:13.271099 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-59fddf47-4fd8-4ea1-ae0f-eb9a5c721a5b None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:13.273716 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-59fddf47-4fd8-4ea1-ae0f-eb9a5c721a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:13.276637 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97677bca-ebd1-4b0e-aa81-1eb8d2d58b9c None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:13.284437 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:13.334624 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:13.346413 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e7bd0-7f2f-4a0f-a692-633e5341f0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:13.347352 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e7bd0-7f2f-4a0f-a692-633e5341f0df None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:13.347638 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e7bd0-7f2f-4a0f-a692-633e5341f0df None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:13.347913 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e7bd0-7f2f-4a0f-a692-633e5341f0df None admin] PATH_INFO: `/v3/projects/b360f1c130384ed8a57179e36d9b4f7d` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:13.349135 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e7bd0-7f2f-4a0f-a692-633e5341f0df None admin] RBAC: Authorizing `identity:get_project(project_id=b360f1c130384ed8a57179e36d9b4f7d)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:13.350584 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e7bd0-7f2f-4a0f-a692-633e5341f0df None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:13.356847 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 101/200] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 13 23:34:13 2022] GET /identity/v3/projects/b360f1c130384ed8a57179e36d9b4f7d => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:13.361715 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e7bd0-7f2f-4a0f-a692-633e5341f0df None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:13.364312 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 100/201] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 23:34:13.398050 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fddf47-4fd8-4ea1-ae0f-eb9a5c721a5b None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:13.474725 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e7bd0-7f2f-4a0f-a692-633e5341f0df None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:13.525145 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fddf47-4fd8-4ea1-ae0f-eb9a5c721a5b None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:13.530200 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ce4b8-5856-48b6-8ec4-14df4d70701d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:13.530890 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ce4b8-5856-48b6-8ec4-14df4d70701d None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:13.531184 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ce4b8-5856-48b6-8ec4-14df4d70701d None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:13.531582 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ce4b8-5856-48b6-8ec4-14df4d70701d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:13.532426 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211ce4b8-5856-48b6-8ec4-14df4d70701d None admin] RBAC: Adding query filter params (role.id=a27ce0a47b0a4f9bac8c6e78d9da4278, scope.project.id=b360f1c130384ed8a57179e36d9b4f7d, user.id=4c6d5ebdee734763b519a59b5c6c836f) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:13.532809 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211ce4b8-5856-48b6-8ec4-14df4d70701d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:13.534227 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211ce4b8-5856-48b6-8ec4-14df4d70701d None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:13.552962 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 102/202] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 13 23:34:13 2022] GET /identity/v3/role_assignments?user.id=4c6d5ebdee734763b519a59b5c6c836f&scope.project.id=b360f1c130384ed8a57179e36d9b4f7d&role.id=a27ce0a47b0a4f9bac8c6e78d9da4278 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:13.580176 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0564089-5e3a-4934-bc1c-649d40d51295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:13.581023 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0564089-5e3a-4934-bc1c-649d40d51295 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:13.581306 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0564089-5e3a-4934-bc1c-649d40d51295 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:13.581586 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0564089-5e3a-4934-bc1c-649d40d51295 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:13.598864 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:13.603132 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0564089-5e3a-4934-bc1c-649d40d51295 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:34:13.612693 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-f0564089-5e3a-4934-bc1c-649d40d51295 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 23:34:13.612693 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:13.612693 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:13.612693 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:13.612693 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:13.612693 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:13.612693 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:13.612693 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:13.612693 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:13.612693 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:13.612693 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:13.612693 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:13.612693 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:34:13.612693 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:34:13.612693 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:34:13.612693 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:34:13.613658 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:34:13.613658 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:34:13.613658 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:34:13.613658 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:34:13.613658 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:13.613658 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:13.613658 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:13.613658 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:13.613658 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:13.613658 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:13.613658 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:13.613658 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:13.613658 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:13.613658 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:13.613658 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:13.613658 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:13.614423 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:13.614423 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:13.614423 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:13.614423 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:13.614423 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:34:13.614423 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:34:13.614423 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:34:13.614423 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:34:13.614423 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:34:13.614423 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:34:13.614423 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 23:34:13.614423 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:34:13.614423 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 101/203] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:34:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:13.622623 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ce4b8-5856-48b6-8ec4-14df4d70701d None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:13.723727 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:13.774892 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ce4b8-5856-48b6-8ec4-14df4d70701d None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:13.814576 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1375f6-30ca-40d0-a28a-29defc945d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:13.815173 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1375f6-30ca-40d0-a28a-29defc945d25 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:13.815460 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1375f6-30ca-40d0-a28a-29defc945d25 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:13.815737 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1375f6-30ca-40d0-a28a-29defc945d25 None admin] PATH_INFO: `/v3/roles` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:13.816491 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1375f6-30ca-40d0-a28a-29defc945d25 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:13.816800 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1375f6-30ca-40d0-a28a-29defc945d25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:13.818284 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1375f6-30ca-40d0-a28a-29defc945d25 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:13.836934 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 103/204] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 13 23:34:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:13.843058 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0564089-5e3a-4934-bc1c-649d40d51295 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:13.960806 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0564089-5e3a-4934-bc1c-649d40d51295 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:13.997665 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698e367-86e1-41d8-a40d-c4804da2b0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:13.998877 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698e367-86e1-41d8-a40d-c4804da2b0dd None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:13.999209 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698e367-86e1-41d8-a40d-c4804da2b0dd None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:13.999495 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698e367-86e1-41d8-a40d-c4804da2b0dd None admin] PATH_INFO: `/v3/users/2b4b23446cd74e6a9b2fbfa174be84a9` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:14.000748 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e698e367-86e1-41d8-a40d-c4804da2b0dd None admin] RBAC: Authorizing `identity:get_user(user_id=2b4b23446cd74e6a9b2fbfa174be84a9)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:14.002241 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e698e367-86e1-41d8-a40d-c4804da2b0dd None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:14.004185 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 102/205] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 13 23:34:13 2022] GET /identity/v3/users/2b4b23446cd74e6a9b2fbfa174be84a9 => generated 289 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:14.009461 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1375f6-30ca-40d0-a28a-29defc945d25 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:14.184424 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1375f6-30ca-40d0-a28a-29defc945d25 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:14.220131 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:14.232125 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02fc10-d9fd-4e7e-aae8-de59939ddf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:14.232780 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02fc10-d9fd-4e7e-aae8-de59939ddf6c None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:14.233102 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02fc10-d9fd-4e7e-aae8-de59939ddf6c None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:14.233381 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02fc10-d9fd-4e7e-aae8-de59939ddf6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:14.307790 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc02fc10-d9fd-4e7e-aae8-de59939ddf6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:14.309572 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc02fc10-d9fd-4e7e-aae8-de59939ddf6c None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:14.409212 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 104/206] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 13 23:34:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 13 23:34:14.418416 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698e367-86e1-41d8-a40d-c4804da2b0dd None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:14.498567 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:14.537271 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698e367-86e1-41d8-a40d-c4804da2b0dd None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:14.577133 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f6448a-276b-453f-b57e-e990e86732e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:14.578950 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6448a-276b-453f-b57e-e990e86732e4 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:14.578950 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6448a-276b-453f-b57e-e990e86732e4 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:14.578950 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6448a-276b-453f-b57e-e990e86732e4 None admin] PATH_INFO: `/v3/projects/815dfc6ab25b4cac9e72ec762bd3d170` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:14.579599 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f6448a-276b-453f-b57e-e990e86732e4 None admin] RBAC: Authorizing `identity:get_project(project_id=815dfc6ab25b4cac9e72ec762bd3d170)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:14.581097 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f6448a-276b-453f-b57e-e990e86732e4 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:14.583126 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 103/207] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 13 23:34:14 2022] GET /identity/v3/projects/815dfc6ab25b4cac9e72ec762bd3d170 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:14.590672 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02fc10-d9fd-4e7e-aae8-de59939ddf6c None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:14.628693 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:14.732744 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02fc10-d9fd-4e7e-aae8-de59939ddf6c None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:14.778608 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feef6f7-6a1b-4eb3-8e69-230d23375e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:14.779606 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feef6f7-6a1b-4eb3-8e69-230d23375e9d None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:14.780088 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feef6f7-6a1b-4eb3-8e69-230d23375e9d None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:14.780573 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feef6f7-6a1b-4eb3-8e69-230d23375e9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:14.781626 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feef6f7-6a1b-4eb3-8e69-230d23375e9d None admin] RBAC: Adding query filter params (role.id=ef94ce01ebc74f67b71913824c20fbe4, scope.project.id=815dfc6ab25b4cac9e72ec762bd3d170, user.id=2b4b23446cd74e6a9b2fbfa174be84a9) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:14.782216 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feef6f7-6a1b-4eb3-8e69-230d23375e9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:14.783855 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feef6f7-6a1b-4eb3-8e69-230d23375e9d None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:14.790402 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 105/208] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 13 23:34:14 2022] GET /identity/v3/role_assignments?user.id=2b4b23446cd74e6a9b2fbfa174be84a9&scope.project.id=815dfc6ab25b4cac9e72ec762bd3d170&role.id=ef94ce01ebc74f67b71913824c20fbe4 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:15.208747 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e4b12e-32ad-4f83-9d3e-3e85b69314a8 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:15.209289 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e4b12e-32ad-4f83-9d3e-3e85b69314a8 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:15.209364 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e4b12e-32ad-4f83-9d3e-3e85b69314a8 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:15.210988 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 104/209] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:15.217146 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09a1ba-c0ab-45c0-b6ce-d75d616a1462 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:15.217449 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09a1ba-c0ab-45c0-b6ce-d75d616a1462 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:15.217712 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09a1ba-c0ab-45c0-b6ce-d75d616a1462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:15.241999 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-ff09a1ba-c0ab-45c0-b6ce-d75d616a1462 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:15.243548 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-ff09a1ba-c0ab-45c0-b6ce-d75d616a1462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:15.276045 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe8e50-7fc2-4ccc-b2fc-e248beb51538 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:15.276333 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe8e50-7fc2-4ccc-b2fc-e248beb51538 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:15.276612 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe8e50-7fc2-4ccc-b2fc-e248beb51538 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:15.278235 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 105/210] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 23:34:15.288052 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68660db3-74eb-4492-8bd1-c8a47f9eedd2 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:15.288356 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68660db3-74eb-4492-8bd1-c8a47f9eedd2 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:15.288632 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68660db3-74eb-4492-8bd1-c8a47f9eedd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:15.307918 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-68660db3-74eb-4492-8bd1-c8a47f9eedd2 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:15.309831 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-68660db3-74eb-4492-8bd1-c8a47f9eedd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:15.334118 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 106/211] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:34:15.359639 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09a1ba-c0ab-45c0-b6ce-d75d616a1462 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:15.379974 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:15.388022 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 106/212] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 23:34:15.417992 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68660db3-74eb-4492-8bd1-c8a47f9eedd2 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:15.468264 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09a1ba-c0ab-45c0-b6ce-d75d616a1462 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:15.504258 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb66b3-97a5-4492-a70e-031054cf09eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:15.504479 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:15.505563 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb66b3-97a5-4492-a70e-031054cf09eb None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:15.506053 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb66b3-97a5-4492-a70e-031054cf09eb None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:15.506551 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb66b3-97a5-4492-a70e-031054cf09eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:15.518662 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb66b3-97a5-4492-a70e-031054cf09eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:34:15.526742 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-deeb66b3-97a5-4492-a70e-031054cf09eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 23:34:15.526742 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:15.526742 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:15.526742 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:15.526742 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:15.526742 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:15.526742 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:15.526742 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:15.526742 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:15.526742 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:15.526742 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:15.526742 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:15.526742 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:34:15.526742 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:34:15.526742 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:34:15.526742 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:34:15.527746 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:34:15.527746 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:34:15.527746 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:34:15.527746 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:34:15.527746 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:15.527746 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:15.527746 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:15.527746 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:15.527746 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:15.527746 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:15.527746 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:15.527746 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:15.527746 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:15.527746 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:15.527746 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:15.527746 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:15.528517 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:15.528517 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:15.528517 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:15.528517 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:15.528517 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:34:15.528517 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:34:15.528517 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:34:15.528517 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:34:15.528517 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:34:15.528517 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:34:15.528517 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 23:34:15.528517 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:34:15.529127 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68660db3-74eb-4492-8bd1-c8a47f9eedd2 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:15.531126 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 107/213] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:34:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:15.537100 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb66b3-97a5-4492-a70e-031054cf09eb None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:15.576166 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc71c81-9807-438d-8cda-843713c2a8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:15.577020 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc71c81-9807-438d-8cda-843713c2a8d8 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:15.577281 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc71c81-9807-438d-8cda-843713c2a8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:15.578141 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc71c81-9807-438d-8cda-843713c2a8d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:15.582894 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc71c81-9807-438d-8cda-843713c2a8d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:15.582894 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc71c81-9807-438d-8cda-843713c2a8d8 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:15.586480 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 107/214] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:34:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:34:15.592635 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc71c81-9807-438d-8cda-843713c2a8d8 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:15.637129 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:15.670958 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb66b3-97a5-4492-a70e-031054cf09eb None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:15.721694 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32cba5-dd5a-4efa-b851-d50073031683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:15.723394 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32cba5-dd5a-4efa-b851-d50073031683 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:15.723394 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32cba5-dd5a-4efa-b851-d50073031683 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:15.723394 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32cba5-dd5a-4efa-b851-d50073031683 None admin] PATH_INFO: `/v3/roles` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:15.723695 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f32cba5-dd5a-4efa-b851-d50073031683 None admin] RBAC: Adding query filter params (name=member) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:15.723887 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f32cba5-dd5a-4efa-b851-d50073031683 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:15.725273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f32cba5-dd5a-4efa-b851-d50073031683 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:15.726702 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc71c81-9807-438d-8cda-843713c2a8d8 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:15.734955 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 108/215] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 13 23:34:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:34:15.740687 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a0433-2630-4e4f-8b9e-c95d4e7774c4 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:15.741001 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a0433-2630-4e4f-8b9e-c95d4e7774c4 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:15.741289 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a0433-2630-4e4f-8b9e-c95d4e7774c4 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:15.742519 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 109/216] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:15.743202 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a0433-2630-4e4f-8b9e-c95d4e7774c4 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:15.767668 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c39c38-f3ef-4aa5-83a5-dbadbac95ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:15.768337 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c39c38-f3ef-4aa5-83a5-dbadbac95ff5 None admin] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:15.768617 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c39c38-f3ef-4aa5-83a5-dbadbac95ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:15.768916 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c39c38-f3ef-4aa5-83a5-dbadbac95ff5 None admin] PATH_INFO: `/v3/users` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:15.769873 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c39c38-f3ef-4aa5-83a5-dbadbac95ff5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:15.771145 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c39c38-f3ef-4aa5-83a5-dbadbac95ff5 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:15.778313 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:15.794247 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 108/217] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jul 13 23:34:15 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 23:34:15.795333 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f218a79-652b-4638-a3c2-bc3f3d9dc5aa None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:15.795613 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f218a79-652b-4638-a3c2-bc3f3d9dc5aa None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:15.795896 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f218a79-652b-4638-a3c2-bc3f3d9dc5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:15.817965 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-0f218a79-652b-4638-a3c2-bc3f3d9dc5aa None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:15.819223 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-0f218a79-652b-4638-a3c2-bc3f3d9dc5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:15.882263 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a0433-2630-4e4f-8b9e-c95d4e7774c4 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:15.901678 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 109/218] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:34:15.924495 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849d5ca-dd69-4947-a325-3168be6ad5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:15.925508 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849d5ca-dd69-4947-a325-3168be6ad5e2 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:15.925798 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849d5ca-dd69-4947-a325-3168be6ad5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:15.926076 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849d5ca-dd69-4947-a325-3168be6ad5e2 None admin] PATH_INFO: `/v3/users/4fcaadc360784cf38ca97a477ad7597d` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:15.927998 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f218a79-652b-4638-a3c2-bc3f3d9dc5aa None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:15.944792 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7849d5ca-dd69-4947-a325-3168be6ad5e2 None admin] RBAC: Authorizing `identity:get_user(user_id=4fcaadc360784cf38ca97a477ad7597d)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:15.947093 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7849d5ca-dd69-4947-a325-3168be6ad5e2 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:15.950458 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 110/219] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 13 23:34:15 2022] GET /identity/v3/users/4fcaadc360784cf38ca97a477ad7597d => generated 297 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:15.953259 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:15.955926 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849d5ca-dd69-4947-a325-3168be6ad5e2 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:16.061622 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f218a79-652b-4638-a3c2-bc3f3d9dc5aa None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:16.085125 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:16.093146 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849d5ca-dd69-4947-a325-3168be6ad5e2 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:16.107949 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db91d9-f5cf-4274-87aa-26b6083dfcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:16.108390 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db91d9-f5cf-4274-87aa-26b6083dfcf8 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:16.108870 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db91d9-f5cf-4274-87aa-26b6083dfcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:16.111197 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db91d9-f5cf-4274-87aa-26b6083dfcf8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:16.122992 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3db91d9-f5cf-4274-87aa-26b6083dfcf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:34:16.131404 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-f3db91d9-f5cf-4274-87aa-26b6083dfcf8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 23:34:16.131404 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:16.131404 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:16.131404 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:16.131404 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:16.131404 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:16.131404 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:16.131404 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:16.131404 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:16.131404 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:16.131404 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:16.131404 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:16.131404 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:34:16.131404 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:34:16.131404 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:34:16.131404 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:34:16.132329 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:34:16.132329 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:34:16.132329 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:34:16.132329 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:34:16.132329 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:16.132329 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:16.132329 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:16.132329 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:16.132329 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:16.132329 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:16.132329 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:16.132329 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:16.132329 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:16.132329 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:16.132329 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:16.132329 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:16.133136 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:16.133136 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:16.133136 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:16.133136 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:16.133136 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:34:16.133136 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:34:16.133136 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:34:16.133136 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:34:16.133136 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:34:16.133136 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:34:16.133136 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 23:34:16.133136 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:34:16.133136 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 110/220] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 13 23:34:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 23:34:16.134287 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee4267-730b-4ba8-a848-95a60640f385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:16.135785 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee4267-730b-4ba8-a848-95a60640f385 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:16.135785 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee4267-730b-4ba8-a848-95a60640f385 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:16.135785 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee4267-730b-4ba8-a848-95a60640f385 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:16.139123 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db91d9-f5cf-4274-87aa-26b6083dfcf8 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:16.223066 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:16.227476 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee4267-730b-4ba8-a848-95a60640f385 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:16.229261 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee4267-730b-4ba8-a848-95a60640f385 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:16.268109 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db91d9-f5cf-4274-87aa-26b6083dfcf8 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:16.307478 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6377b3-a9e0-43ec-b4ca-9842af0688e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:16.308144 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6377b3-a9e0-43ec-b4ca-9842af0688e7 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:16.309023 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6377b3-a9e0-43ec-b4ca-9842af0688e7 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:16.309306 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6377b3-a9e0-43ec-b4ca-9842af0688e7 None admin] PATH_INFO: `/v3/roles` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:16.310509 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6377b3-a9e0-43ec-b4ca-9842af0688e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:16.310617 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6377b3-a9e0-43ec-b4ca-9842af0688e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:16.312056 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6377b3-a9e0-43ec-b4ca-9842af0688e7 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:16.327296 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 111/221] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:34:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:34:16.328689 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6377b3-a9e0-43ec-b4ca-9842af0688e7 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:16.366429 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 111/222] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 13 23:34:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 23:34:16.374929 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee4267-730b-4ba8-a848-95a60640f385 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:16.395599 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:16.465680 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6377b3-a9e0-43ec-b4ca-9842af0688e7 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:16.495695 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:16.499529 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b8d15-14fe-42a1-80c0-de63ece203cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:16.500588 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b8d15-14fe-42a1-80c0-de63ece203cf None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:16.500892 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b8d15-14fe-42a1-80c0-de63ece203cf None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:16.501169 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b8d15-14fe-42a1-80c0-de63ece203cf None admin] PATH_INFO: `/v3/users/4c6d5ebdee734763b519a59b5c6c836f` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:16.502387 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266b8d15-14fe-42a1-80c0-de63ece203cf None admin] RBAC: Authorizing `identity:get_user(user_id=4c6d5ebdee734763b519a59b5c6c836f)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:16.502968 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee4267-730b-4ba8-a848-95a60640f385 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:16.503825 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266b8d15-14fe-42a1-80c0-de63ece203cf None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:16.509944 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 112/223] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 13 23:34:16 2022] GET /identity/v3/users/4c6d5ebdee734763b519a59b5c6c836f => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:16.512525 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b8d15-14fe-42a1-80c0-de63ece203cf None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:16.570429 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f9fd4-d1e9-43f5-b879-29e486520297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:16.571622 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f9fd4-d1e9-43f5-b879-29e486520297 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:16.572284 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f9fd4-d1e9-43f5-b879-29e486520297 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:16.572667 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f9fd4-d1e9-43f5-b879-29e486520297 None admin] PATH_INFO: `/v3/projects/b360f1c130384ed8a57179e36d9b4f7d` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:16.575255 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903f9fd4-d1e9-43f5-b879-29e486520297 None admin] RBAC: Authorizing `identity:get_project(project_id=b360f1c130384ed8a57179e36d9b4f7d)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:16.577209 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903f9fd4-d1e9-43f5-b879-29e486520297 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:16.579728 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 112/224] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 13 23:34:16 2022] GET /identity/v3/projects/b360f1c130384ed8a57179e36d9b4f7d => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:34:16.581864 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41c774-6d17-4e62-bc77-4e604745d45d None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:16.586739 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41c774-6d17-4e62-bc77-4e604745d45d None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:16.587120 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41c774-6d17-4e62-bc77-4e604745d45d None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:16.588810 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 113/225] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:16.590248 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41c774-6d17-4e62-bc77-4e604745d45d None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:16.642322 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b8d15-14fe-42a1-80c0-de63ece203cf None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:16.655033 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:16.681949 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ab91a-3b6a-46e9-b0af-db9374b82148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:16.682819 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ab91a-3b6a-46e9-b0af-db9374b82148 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:16.683108 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ab91a-3b6a-46e9-b0af-db9374b82148 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:16.683476 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ab91a-3b6a-46e9-b0af-db9374b82148 None admin] PATH_INFO: `/v3/projects/b360f1c130384ed8a57179e36d9b4f7d` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:16.685871 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ab91a-3b6a-46e9-b0af-db9374b82148 None admin] RBAC: Authorizing `identity:get_project(project_id=b360f1c130384ed8a57179e36d9b4f7d)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:16.687379 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ab91a-3b6a-46e9-b0af-db9374b82148 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:16.689482 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 113/226] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 13 23:34:16 2022] GET /identity/v3/projects/b360f1c130384ed8a57179e36d9b4f7d => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:16.690664 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfff4e-d26b-4bad-9b12-9d183d759532 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:16.690959 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfff4e-d26b-4bad-9b12-9d183d759532 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:16.691239 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfff4e-d26b-4bad-9b12-9d183d759532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:16.709934 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-dfcfff4e-d26b-4bad-9b12-9d183d759532 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:16.711426 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-dfcfff4e-d26b-4bad-9b12-9d183d759532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:16.717770 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41c774-6d17-4e62-bc77-4e604745d45d None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:16.756492 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea0a3c-dd48-42c8-9232-93cf03ad10cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:16.757039 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea0a3c-dd48-42c8-9232-93cf03ad10cd None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:16.757384 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea0a3c-dd48-42c8-9232-93cf03ad10cd None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:16.757667 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea0a3c-dd48-42c8-9232-93cf03ad10cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:16.758571 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ea0a3c-dd48-42c8-9232-93cf03ad10cd None admin] RBAC: Adding query filter params (role.id=69842edf01cf43eb814bb066f9652f48, scope.project.id=b360f1c130384ed8a57179e36d9b4f7d, user.id=4fcaadc360784cf38ca97a477ad7597d) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:16.758938 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ea0a3c-dd48-42c8-9232-93cf03ad10cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:16.760538 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ea0a3c-dd48-42c8-9232-93cf03ad10cd None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:16.768575 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 114/227] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 13 23:34:16 2022] GET /identity/v3/role_assignments?user.id=4fcaadc360784cf38ca97a477ad7597d&scope.project.id=b360f1c130384ed8a57179e36d9b4f7d&role.id=69842edf01cf43eb814bb066f9652f48 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:16.774002 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea0a3c-dd48-42c8-9232-93cf03ad10cd None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:16.816647 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 114/228] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:34:16.849381 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:16.873130 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcfff4e-d26b-4bad-9b12-9d183d759532 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:16.971711 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea0a3c-dd48-42c8-9232-93cf03ad10cd None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:17.028070 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd510e0-6dcc-4069-8b64-321e11e2dbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:17.029157 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd510e0-6dcc-4069-8b64-321e11e2dbe2 None admin] REQUEST_METHOD: `PUT` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:17.029445 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd510e0-6dcc-4069-8b64-321e11e2dbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:17.029722 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd510e0-6dcc-4069-8b64-321e11e2dbe2 None admin] PATH_INFO: `/v3/projects/b360f1c130384ed8a57179e36d9b4f7d/users/4c6d5ebdee734763b519a59b5c6c836f/roles/46deff0e06964626a5600c9641454603` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:17.033091 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd510e0-6dcc-4069-8b64-321e11e2dbe2 None admin] RBAC: Authorizing `identity:create_grant(project_id=b360f1c130384ed8a57179e36d9b4f7d, user_id=4c6d5ebdee734763b519a59b5c6c836f, role_id=46deff0e06964626a5600c9641454603)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:17.034574 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd510e0-6dcc-4069-8b64-321e11e2dbe2 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:17.053282 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 115/229] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jul 13 23:34:16 2022] PUT /identity/v3/projects/b360f1c130384ed8a57179e36d9b4f7d/users/4c6d5ebdee734763b519a59b5c6c836f/roles/46deff0e06964626a5600c9641454603 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 23:34:17.062313 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcfff4e-d26b-4bad-9b12-9d183d759532 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:17.082868 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:17.116605 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199080d-afbe-42d3-8ce5-c8f1e9fb3c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:17.117368 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199080d-afbe-42d3-8ce5-c8f1e9fb3c3b None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:17.117653 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199080d-afbe-42d3-8ce5-c8f1e9fb3c3b None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:17.117932 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199080d-afbe-42d3-8ce5-c8f1e9fb3c3b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:17.134784 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2199080d-afbe-42d3-8ce5-c8f1e9fb3c3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:34:17.148491 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-2199080d-afbe-42d3-8ce5-c8f1e9fb3c3b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 23:34:17.148491 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:17.148491 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:17.148491 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:17.148491 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:17.148491 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:17.148491 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:17.148491 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:17.148491 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:17.148491 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:17.148491 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:17.148491 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:17.148491 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:34:17.148491 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:34:17.148491 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:34:17.148491 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:34:17.149675 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:34:17.149675 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:34:17.149675 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:34:17.149675 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:34:17.149675 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:17.149675 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:17.149675 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:17.149675 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:17.149675 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:17.149675 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:17.149675 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:17.149675 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:17.149675 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:17.149675 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:17.149675 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:17.149675 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:17.151852 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:17.151852 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:17.151852 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:17.151852 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:17.151852 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:34:17.151852 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:34:17.151852 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:34:17.151852 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:34:17.151852 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:34:17.151852 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:34:17.151852 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 23:34:17.151852 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:34:17.151852 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 115/230] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jul 13 23:34:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 23:34:17.156613 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd510e0-6dcc-4069-8b64-321e11e2dbe2 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:17.284711 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:17.300138 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd510e0-6dcc-4069-8b64-321e11e2dbe2 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:17.346836 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f08c35-c52e-48ac-8122-ea81b79ba48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:17.347523 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f08c35-c52e-48ac-8122-ea81b79ba48c None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:17.347811 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f08c35-c52e-48ac-8122-ea81b79ba48c None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:17.348094 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f08c35-c52e-48ac-8122-ea81b79ba48c None admin] PATH_INFO: `/v3/roles` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:17.348943 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f08c35-c52e-48ac-8122-ea81b79ba48c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:17.349257 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f08c35-c52e-48ac-8122-ea81b79ba48c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:17.350693 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f08c35-c52e-48ac-8122-ea81b79ba48c None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:17.360919 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 116/231] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 13 23:34:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:17.370076 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199080d-afbe-42d3-8ce5-c8f1e9fb3c3b None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:17.506089 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199080d-afbe-42d3-8ce5-c8f1e9fb3c3b None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:17.553802 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8579788-4e17-4122-b79a-7f502c91eb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:17.555027 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8579788-4e17-4122-b79a-7f502c91eb5e None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:17.555504 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8579788-4e17-4122-b79a-7f502c91eb5e None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:17.555992 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8579788-4e17-4122-b79a-7f502c91eb5e None admin] PATH_INFO: `/v3/users/4c6d5ebdee734763b519a59b5c6c836f` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:17.557442 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8579788-4e17-4122-b79a-7f502c91eb5e None admin] RBAC: Authorizing `identity:get_user(user_id=4c6d5ebdee734763b519a59b5c6c836f)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:17.559399 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8579788-4e17-4122-b79a-7f502c91eb5e None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:17.561580 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 116/232] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 13 23:34:17 2022] GET /identity/v3/users/4c6d5ebdee734763b519a59b5c6c836f => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:17.570148 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f08c35-c52e-48ac-8122-ea81b79ba48c None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:17.704652 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f08c35-c52e-48ac-8122-ea81b79ba48c None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:17.744321 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19095d57-c63e-404a-a8d0-96e7d6b856fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:17.745220 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19095d57-c63e-404a-a8d0-96e7d6b856fd None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:17.745540 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19095d57-c63e-404a-a8d0-96e7d6b856fd None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:17.745780 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19095d57-c63e-404a-a8d0-96e7d6b856fd None admin] PATH_INFO: `/v3/projects/b360f1c130384ed8a57179e36d9b4f7d` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:17.747873 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19095d57-c63e-404a-a8d0-96e7d6b856fd None admin] RBAC: Authorizing `identity:get_project(project_id=b360f1c130384ed8a57179e36d9b4f7d)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:17.749383 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19095d57-c63e-404a-a8d0-96e7d6b856fd None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:17.751087 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 117/233] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 13 23:34:17 2022] GET /identity/v3/projects/b360f1c130384ed8a57179e36d9b4f7d => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:17.756841 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8579788-4e17-4122-b79a-7f502c91eb5e None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:17.813882 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:17.932453 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8579788-4e17-4122-b79a-7f502c91eb5e None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:17.990813 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135546ed-a20f-4533-9bb7-00a47f46de85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:17.991635 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135546ed-a20f-4533-9bb7-00a47f46de85 None admin] REQUEST_METHOD: `PUT` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:17.991921 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135546ed-a20f-4533-9bb7-00a47f46de85 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:17.992206 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135546ed-a20f-4533-9bb7-00a47f46de85 None admin] PATH_INFO: `/v3/projects/b360f1c130384ed8a57179e36d9b4f7d/users/4c6d5ebdee734763b519a59b5c6c836f/roles/a27ce0a47b0a4f9bac8c6e78d9da4278` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:17.998830 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135546ed-a20f-4533-9bb7-00a47f46de85 None admin] RBAC: Authorizing `identity:create_grant(project_id=b360f1c130384ed8a57179e36d9b4f7d, user_id=4c6d5ebdee734763b519a59b5c6c836f, role_id=a27ce0a47b0a4f9bac8c6e78d9da4278)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:18.000278 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135546ed-a20f-4533-9bb7-00a47f46de85 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:18.035512 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 117/234] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jul 13 23:34:17 2022] PUT /identity/v3/projects/b360f1c130384ed8a57179e36d9b4f7d/users/4c6d5ebdee734763b519a59b5c6c836f/roles/a27ce0a47b0a4f9bac8c6e78d9da4278 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 23:34:18.813395 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c96264-ca89-443a-92ba-66eb6c09773b None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:18.813878 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c96264-ca89-443a-92ba-66eb6c09773b None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:18.813878 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c96264-ca89-443a-92ba-66eb6c09773b None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:18.815467 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 118/235] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:18.820782 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f48071-a8c6-479e-b66d-c53c9071942b None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:18.821217 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f48071-a8c6-479e-b66d-c53c9071942b None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:18.821388 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f48071-a8c6-479e-b66d-c53c9071942b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:18.827748 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b693b97-291d-4950-a0cb-941d17b70529 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:18.828035 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b693b97-291d-4950-a0cb-941d17b70529 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:18.828319 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b693b97-291d-4950-a0cb-941d17b70529 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:18.829971 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 119/236] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 23:34:18.834941 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59646f2-7afc-4155-9acc-24fcaa23ce7a None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:18.835236 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59646f2-7afc-4155-9acc-24fcaa23ce7a None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:18.835523 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59646f2-7afc-4155-9acc-24fcaa23ce7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:18.838980 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-43f48071-a8c6-479e-b66d-c53c9071942b None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:18.840795 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-43f48071-a8c6-479e-b66d-c53c9071942b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:18.862522 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-b59646f2-7afc-4155-9acc-24fcaa23ce7a None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:18.863675 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-b59646f2-7afc-4155-9acc-24fcaa23ce7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:18.899042 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:18.910549 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 118/237] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:34:18.936689 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f48071-a8c6-479e-b66d-c53c9071942b None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:18.972059 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:18.993357 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 120/238] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:34:19.022151 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59646f2-7afc-4155-9acc-24fcaa23ce7a None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:19.051067 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f48071-a8c6-479e-b66d-c53c9071942b None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:19.088815 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ccdc98-3bc4-465c-ab8f-0adf739c18f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:19.089780 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccdc98-3bc4-465c-ab8f-0adf739c18f0 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:19.090136 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccdc98-3bc4-465c-ab8f-0adf739c18f0 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:19.090486 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccdc98-3bc4-465c-ab8f-0adf739c18f0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:19.101951 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ccdc98-3bc4-465c-ab8f-0adf739c18f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:34:19.110058 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-a0ccdc98-3bc4-465c-ab8f-0adf739c18f0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 23:34:19.110058 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:19.110058 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:19.110058 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:19.110058 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:19.110058 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:19.110058 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:19.110058 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:19.110058 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:19.110058 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:19.110058 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:19.110058 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:19.110058 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:34:19.110058 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:34:19.110058 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:34:19.110058 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:34:19.110932 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:34:19.110932 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:34:19.110932 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:34:19.110932 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:34:19.110932 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:19.110932 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:19.110932 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:19.110932 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:19.110932 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:19.110932 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:19.110932 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:19.110932 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:19.110932 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:19.110932 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:19.110932 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:19.110932 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:19.111701 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:19.111701 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:19.111701 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:19.111701 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:19.111701 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:34:19.111701 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:34:19.111701 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:34:19.111701 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:34:19.111701 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:34:19.111701 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:34:19.111701 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 23:34:19.111701 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:34:19.111701 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 119/239] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:34:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:19.117532 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ccdc98-3bc4-465c-ab8f-0adf739c18f0 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:19.149487 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59646f2-7afc-4155-9acc-24fcaa23ce7a None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:19.190237 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec60960-007e-4de9-a18e-8679bf7ee236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:19.191440 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec60960-007e-4de9-a18e-8679bf7ee236 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:19.191731 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec60960-007e-4de9-a18e-8679bf7ee236 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:19.192013 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec60960-007e-4de9-a18e-8679bf7ee236 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:19.193228 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec60960-007e-4de9-a18e-8679bf7ee236 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:19.195229 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec60960-007e-4de9-a18e-8679bf7ee236 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:19.197243 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 121/240] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:34:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:34:19.203012 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec60960-007e-4de9-a18e-8679bf7ee236 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:19.241180 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:19.272003 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:19.302927 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ccdc98-3bc4-465c-ab8f-0adf739c18f0 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:19.312468 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec60960-007e-4de9-a18e-8679bf7ee236 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:19.357710 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a267b-eb02-47a0-906b-12e89b931c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:19.358307 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a267b-eb02-47a0-906b-12e89b931c32 None admin] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:19.358595 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a267b-eb02-47a0-906b-12e89b931c32 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:19.358875 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a267b-eb02-47a0-906b-12e89b931c32 None admin] PATH_INFO: `/v3/users` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:19.359597 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0a267b-eb02-47a0-906b-12e89b931c32 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:19.363284 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0a267b-eb02-47a0-906b-12e89b931c32 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:19.374794 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a3d18d-fac7-4df4-a428-f03443b77399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:19.375468 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3d18d-fac7-4df4-a428-f03443b77399 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:19.375809 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3d18d-fac7-4df4-a428-f03443b77399 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:19.376145 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3d18d-fac7-4df4-a428-f03443b77399 None admin] PATH_INFO: `/v3/roles` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:19.376972 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a3d18d-fac7-4df4-a428-f03443b77399 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:19.377283 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a3d18d-fac7-4df4-a428-f03443b77399 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:19.378728 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a3d18d-fac7-4df4-a428-f03443b77399 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:19.394524 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 120/241] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 13 23:34:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:19.402421 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 122/242] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jul 13 23:34:19 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 23:34:19.403586 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a3d18d-fac7-4df4-a428-f03443b77399 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:19.564745 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a3d18d-fac7-4df4-a428-f03443b77399 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:19.626762 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57dc0a-1f53-486f-a93c-fef861c12498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:19.627981 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57dc0a-1f53-486f-a93c-fef861c12498 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:19.628461 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57dc0a-1f53-486f-a93c-fef861c12498 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:19.628949 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57dc0a-1f53-486f-a93c-fef861c12498 None admin] PATH_INFO: `/v3/users/ae0d4ebcd6234ad5a9bd60727f7ac309` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:19.631048 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d030f-75c5-4324-951f-823de61a81b3 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:19.631373 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d030f-75c5-4324-951f-823de61a81b3 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:19.631626 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d030f-75c5-4324-951f-823de61a81b3 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:19.633469 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 123/243] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 23:34:19.641963 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5695678-f21e-4660-a2ca-6ab8780c9082 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:19.641963 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5695678-f21e-4660-a2ca-6ab8780c9082 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:19.641963 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5695678-f21e-4660-a2ca-6ab8780c9082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:19.649184 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed57dc0a-1f53-486f-a93c-fef861c12498 None admin] RBAC: Authorizing `identity:get_user(user_id=ae0d4ebcd6234ad5a9bd60727f7ac309)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:19.650922 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed57dc0a-1f53-486f-a93c-fef861c12498 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:19.653491 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 121/244] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 13 23:34:19 2022] GET /identity/v3/users/ae0d4ebcd6234ad5a9bd60727f7ac309 => generated 297 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:19.659217 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57dc0a-1f53-486f-a93c-fef861c12498 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:19.659526 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-e5695678-f21e-4660-a2ca-6ab8780c9082 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:19.660869 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-e5695678-f21e-4660-a2ca-6ab8780c9082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:19.671240 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:19.776723 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 124/245] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 23:34:19.800638 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5695678-f21e-4660-a2ca-6ab8780c9082 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:19.801205 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57dc0a-1f53-486f-a93c-fef861c12498 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:19.809868 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:19.854662 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a5b07-9a07-44eb-8f29-b988a46d982f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:19.855520 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a5b07-9a07-44eb-8f29-b988a46d982f None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:19.855865 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a5b07-9a07-44eb-8f29-b988a46d982f None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:19.856150 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a5b07-9a07-44eb-8f29-b988a46d982f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:19.930731 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5695678-f21e-4660-a2ca-6ab8780c9082 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:19.938235 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a5b07-9a07-44eb-8f29-b988a46d982f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:19.939714 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a5b07-9a07-44eb-8f29-b988a46d982f None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:19.949218 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:19.973957 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e03d4-1746-42d2-b37e-805534587c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:19.975021 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e03d4-1746-42d2-b37e-805534587c5a None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:19.975448 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e03d4-1746-42d2-b37e-805534587c5a None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:19.975862 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e03d4-1746-42d2-b37e-805534587c5a None admin] PATH_INFO: `/v3/roles/member` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:19.987793 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e03d4-1746-42d2-b37e-805534587c5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:34:19.997133 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-3b6e03d4-1746-42d2-b37e-805534587c5a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 23:34:19.997133 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:19.997133 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:19.997133 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:19.997133 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:19.997133 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:19.997133 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:19.997133 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:19.997133 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:19.997133 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:19.997133 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:19.997133 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:19.997133 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:34:19.997133 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:34:19.997133 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:34:19.997133 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:34:19.998031 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:34:19.998031 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:34:19.998031 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:34:19.998031 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:34:19.998031 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:19.998031 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:19.998031 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:19.998031 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:19.998031 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:19.998031 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:19.998031 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:19.998031 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:19.998031 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:19.998031 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:19.998031 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:19.998031 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:19.998813 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:19.998813 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:19.998813 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:19.998813 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:19.998813 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:34:19.998813 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:34:19.998813 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:34:19.998813 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:34:19.998813 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:34:19.998813 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:34:19.998813 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 23:34:19.998813 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:34:20.001625 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 125/246] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:34:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 23:34:20.007843 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e03d4-1746-42d2-b37e-805534587c5a None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:20.049565 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 122/247] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 13 23:34:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 23:34:20.055208 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a5b07-9a07-44eb-8f29-b988a46d982f None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:20.078885 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:20.124214 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e03d4-1746-42d2-b37e-805534587c5a None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:20.171788 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09747630-8867-4391-bd52-8c0b1c82e0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:20.172757 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09747630-8867-4391-bd52-8c0b1c82e0ea None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:20.172889 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a5b07-9a07-44eb-8f29-b988a46d982f None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:20.173435 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09747630-8867-4391-bd52-8c0b1c82e0ea None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:20.173854 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09747630-8867-4391-bd52-8c0b1c82e0ea None admin] PATH_INFO: `/v3/roles` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:20.175901 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09747630-8867-4391-bd52-8c0b1c82e0ea None admin] RBAC: Adding query filter params (name=member) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:20.176360 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09747630-8867-4391-bd52-8c0b1c82e0ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:20.177925 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09747630-8867-4391-bd52-8c0b1c82e0ea None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:20.180970 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:20.189926 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 126/248] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 13 23:34:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:20.191994 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973c779-9288-4093-97ab-607d41e2d611 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:20.192466 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973c779-9288-4093-97ab-607d41e2d611 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:20.192948 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973c779-9288-4093-97ab-607d41e2d611 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:20.194619 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 127/249] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:20.195969 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d973c779-9288-4093-97ab-607d41e2d611 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:20.217272 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc057cd-afc1-4a01-86f0-d27cf3c97783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:20.218422 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc057cd-afc1-4a01-86f0-d27cf3c97783 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:20.218968 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc057cd-afc1-4a01-86f0-d27cf3c97783 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:20.219411 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc057cd-afc1-4a01-86f0-d27cf3c97783 None admin] PATH_INFO: `/v3/projects/b360f1c130384ed8a57179e36d9b4f7d` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:20.220852 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc057cd-afc1-4a01-86f0-d27cf3c97783 None admin] RBAC: Authorizing `identity:get_project(project_id=b360f1c130384ed8a57179e36d9b4f7d)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:20.222559 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc057cd-afc1-4a01-86f0-d27cf3c97783 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:20.224506 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 123/250] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 13 23:34:20 2022] GET /identity/v3/projects/b360f1c130384ed8a57179e36d9b4f7d => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:34:20.225963 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9539efa-3c55-4820-b7e5-cb3aee9d3848 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:20.226559 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9539efa-3c55-4820-b7e5-cb3aee9d3848 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:20.226889 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9539efa-3c55-4820-b7e5-cb3aee9d3848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:20.246583 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-d9539efa-3c55-4820-b7e5-cb3aee9d3848 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:20.247983 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-d9539efa-3c55-4820-b7e5-cb3aee9d3848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:20.324431 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d973c779-9288-4093-97ab-607d41e2d611 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:20.325492 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 124/251] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:34:20.326603 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9539efa-3c55-4820-b7e5-cb3aee9d3848 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:20.360392 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:20.372553 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48809f51-53a8-46b5-ae4c-033dea7c8cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:20.374234 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48809f51-53a8-46b5-ae4c-033dea7c8cc4 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:20.374629 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48809f51-53a8-46b5-ae4c-033dea7c8cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:20.375002 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48809f51-53a8-46b5-ae4c-033dea7c8cc4 None admin] PATH_INFO: `/v3/users/4fcaadc360784cf38ca97a477ad7597d` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:20.377021 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48809f51-53a8-46b5-ae4c-033dea7c8cc4 None admin] RBAC: Authorizing `identity:get_user(user_id=4fcaadc360784cf38ca97a477ad7597d)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:20.379540 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48809f51-53a8-46b5-ae4c-033dea7c8cc4 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:20.382227 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 128/252] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 13 23:34:20 2022] GET /identity/v3/users/4fcaadc360784cf38ca97a477ad7597d => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:20.385216 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48809f51-53a8-46b5-ae4c-033dea7c8cc4 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:20.453331 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9539efa-3c55-4820-b7e5-cb3aee9d3848 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:20.479050 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:20.494736 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad238e7-4f7b-446d-803d-782ea8e7e455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:20.496461 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad238e7-4f7b-446d-803d-782ea8e7e455 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:20.497720 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad238e7-4f7b-446d-803d-782ea8e7e455 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:20.498745 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad238e7-4f7b-446d-803d-782ea8e7e455 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:20.499949 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad238e7-4f7b-446d-803d-782ea8e7e455 None admin] RBAC: Adding query filter params (role.id=ef94ce01ebc74f67b71913824c20fbe4, scope.project.id=b360f1c130384ed8a57179e36d9b4f7d, user.id=ae0d4ebcd6234ad5a9bd60727f7ac309) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:20.502650 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad238e7-4f7b-446d-803d-782ea8e7e455 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:20.504330 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad238e7-4f7b-446d-803d-782ea8e7e455 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:20.515364 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 125/253] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 13 23:34:20 2022] GET /identity/v3/role_assignments?user.id=ae0d4ebcd6234ad5a9bd60727f7ac309&scope.project.id=b360f1c130384ed8a57179e36d9b4f7d&role.id=ef94ce01ebc74f67b71913824c20fbe4 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:20.520898 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad238e7-4f7b-446d-803d-782ea8e7e455 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:20.578975 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48809f51-53a8-46b5-ae4c-033dea7c8cc4 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:20.618547 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9d9fc-6c95-4f3b-9b8c-54084f15400b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:20.619601 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9d9fc-6c95-4f3b-9b8c-54084f15400b None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:20.620125 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9d9fc-6c95-4f3b-9b8c-54084f15400b None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:20.620611 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9d9fc-6c95-4f3b-9b8c-54084f15400b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:20.632934 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc9d9fc-6c95-4f3b-9b8c-54084f15400b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:34:20.641539 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-bdc9d9fc-6c95-4f3b-9b8c-54084f15400b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 23:34:20.641539 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:20.641539 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:20.641539 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:20.641539 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:20.641539 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:20.641539 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:20.641539 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:20.641539 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:20.641539 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:20.641539 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:20.641539 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:20.641539 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:34:20.641539 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:34:20.641539 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:34:20.641539 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:34:20.642499 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:34:20.642499 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:34:20.642499 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:34:20.642499 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:34:20.642499 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:20.642499 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:20.642499 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:20.642499 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:20.642499 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:20.642499 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:20.642499 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:20.642499 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:20.642499 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:20.642499 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:20.642499 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:20.642499 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:20.643278 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:20.643278 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:20.643278 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:20.643278 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:20.643278 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:34:20.643278 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:34:20.643278 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:34:20.643278 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:34:20.643278 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:34:20.643278 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:34:20.643278 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 23:34:20.643278 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:34:20.646051 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 129/254] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 13 23:34:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 23:34:20.652620 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9d9fc-6c95-4f3b-9b8c-54084f15400b None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:20.716245 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:20.734574 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad238e7-4f7b-446d-803d-782ea8e7e455 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:20.767771 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9d9fc-6c95-4f3b-9b8c-54084f15400b None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:20.805421 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e3874-6465-4700-872d-775025c335e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:20.806492 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e3874-6465-4700-872d-775025c335e6 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:20.806980 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e3874-6465-4700-872d-775025c335e6 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:20.807475 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e3874-6465-4700-872d-775025c335e6 None admin] PATH_INFO: `/v3/roles` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:20.809020 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31e3874-6465-4700-872d-775025c335e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:20.809556 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31e3874-6465-4700-872d-775025c335e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:20.811199 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31e3874-6465-4700-872d-775025c335e6 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:20.820647 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 130/255] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:34:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:34:20.827405 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e3874-6465-4700-872d-775025c335e6 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:20.831193 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07115cbd-74dd-4cba-bb6b-89bec49cb2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:20.832077 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07115cbd-74dd-4cba-bb6b-89bec49cb2da None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:20.832528 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07115cbd-74dd-4cba-bb6b-89bec49cb2da None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:20.832961 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07115cbd-74dd-4cba-bb6b-89bec49cb2da None admin] PATH_INFO: `/v3/projects/b360f1c130384ed8a57179e36d9b4f7d` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:20.834350 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07115cbd-74dd-4cba-bb6b-89bec49cb2da None admin] RBAC: Authorizing `identity:get_project(project_id=b360f1c130384ed8a57179e36d9b4f7d)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:20.835943 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07115cbd-74dd-4cba-bb6b-89bec49cb2da None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:20.838195 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 126/256] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 13 23:34:20 2022] GET /identity/v3/projects/b360f1c130384ed8a57179e36d9b4f7d => generated 302 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:20.844132 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07115cbd-74dd-4cba-bb6b-89bec49cb2da None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:20.889079 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:20.936748 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e3874-6465-4700-872d-775025c335e6 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:20.957441 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:20.962644 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07115cbd-74dd-4cba-bb6b-89bec49cb2da None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:20.972041 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd45ff-bfe4-4c1b-ac9d-da7f5f9ba7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:20.972987 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd45ff-bfe4-4c1b-ac9d-da7f5f9ba7a5 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:20.973499 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd45ff-bfe4-4c1b-ac9d-da7f5f9ba7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:20.973976 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd45ff-bfe4-4c1b-ac9d-da7f5f9ba7a5 None admin] PATH_INFO: `/v3/users/4c6d5ebdee734763b519a59b5c6c836f` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:20.975389 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd45ff-bfe4-4c1b-ac9d-da7f5f9ba7a5 None admin] RBAC: Authorizing `identity:get_user(user_id=4c6d5ebdee734763b519a59b5c6c836f)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:20.977084 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd45ff-bfe4-4c1b-ac9d-da7f5f9ba7a5 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:20.979208 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 131/257] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 13 23:34:20 2022] GET /identity/v3/users/4c6d5ebdee734763b519a59b5c6c836f => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:20.985547 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd45ff-bfe4-4c1b-ac9d-da7f5f9ba7a5 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:21.005202 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151e851-468c-45ac-bb2a-bf7dfef09e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:21.006386 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151e851-468c-45ac-bb2a-bf7dfef09e7e None admin] REQUEST_METHOD: `PUT` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:21.006887 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151e851-468c-45ac-bb2a-bf7dfef09e7e None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:21.007331 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151e851-468c-45ac-bb2a-bf7dfef09e7e None admin] PATH_INFO: `/v3/projects/b360f1c130384ed8a57179e36d9b4f7d/users/4fcaadc360784cf38ca97a477ad7597d/roles/69842edf01cf43eb814bb066f9652f48` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:21.009660 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2151e851-468c-45ac-bb2a-bf7dfef09e7e None admin] RBAC: Authorizing `identity:create_grant(project_id=b360f1c130384ed8a57179e36d9b4f7d, user_id=4fcaadc360784cf38ca97a477ad7597d, role_id=69842edf01cf43eb814bb066f9652f48)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:21.011492 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2151e851-468c-45ac-bb2a-bf7dfef09e7e None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:21.042209 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 127/258] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jul 13 23:34:20 2022] PUT /identity/v3/projects/b360f1c130384ed8a57179e36d9b4f7d/users/4fcaadc360784cf38ca97a477ad7597d/roles/69842edf01cf43eb814bb066f9652f48 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 23:34:21.096985 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd45ff-bfe4-4c1b-ac9d-da7f5f9ba7a5 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:21.132404 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311701ec-3835-457f-ad4d-bb0ce3d39eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:21.133100 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311701ec-3835-457f-ad4d-bb0ce3d39eeb None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:21.133388 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311701ec-3835-457f-ad4d-bb0ce3d39eeb None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:21.133720 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311701ec-3835-457f-ad4d-bb0ce3d39eeb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:21.191567 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:21.208876 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311701ec-3835-457f-ad4d-bb0ce3d39eeb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:21.210361 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311701ec-3835-457f-ad4d-bb0ce3d39eeb None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:21.317152 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 132/259] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 13 23:34:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 13 23:34:21.322936 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151e851-468c-45ac-bb2a-bf7dfef09e7e None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:21.447635 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:21.454775 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151e851-468c-45ac-bb2a-bf7dfef09e7e None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:21.497970 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86237c2-bd9c-4cea-837b-2d2fdee1e91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:21.498883 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86237c2-bd9c-4cea-837b-2d2fdee1e91b None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:21.499165 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86237c2-bd9c-4cea-837b-2d2fdee1e91b None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:21.499436 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86237c2-bd9c-4cea-837b-2d2fdee1e91b None admin] PATH_INFO: `/v3/projects/b360f1c130384ed8a57179e36d9b4f7d` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:21.500654 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86237c2-bd9c-4cea-837b-2d2fdee1e91b None admin] RBAC: Authorizing `identity:get_project(project_id=b360f1c130384ed8a57179e36d9b4f7d)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:21.502141 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86237c2-bd9c-4cea-837b-2d2fdee1e91b None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:21.504231 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 128/260] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 13 23:34:21 2022] GET /identity/v3/projects/b360f1c130384ed8a57179e36d9b4f7d => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:21.510049 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311701ec-3835-457f-ad4d-bb0ce3d39eeb None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:21.598422 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:21.600371 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ce69a-5088-4dd0-9d57-10ac30badcbf None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:21.600660 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ce69a-5088-4dd0-9d57-10ac30badcbf None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:21.600977 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ce69a-5088-4dd0-9d57-10ac30badcbf None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:21.602677 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 129/261] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:21.614520 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009d3d3-67d7-44bc-af9d-a98d7d4821cf None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:21.614854 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009d3d3-67d7-44bc-af9d-a98d7d4821cf None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:21.615140 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009d3d3-67d7-44bc-af9d-a98d7d4821cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:21.623049 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311701ec-3835-457f-ad4d-bb0ce3d39eeb None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:21.636197 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-1009d3d3-67d7-44bc-af9d-a98d7d4821cf None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:21.638513 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-1009d3d3-67d7-44bc-af9d-a98d7d4821cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:21.698361 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652cb03-2822-445b-90fb-fa4836b2d975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:21.699594 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652cb03-2822-445b-90fb-fa4836b2d975 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:21.700109 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652cb03-2822-445b-90fb-fa4836b2d975 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:21.700400 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652cb03-2822-445b-90fb-fa4836b2d975 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:21.702168 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b652cb03-2822-445b-90fb-fa4836b2d975 None admin] RBAC: Adding query filter params (role.id=46deff0e06964626a5600c9641454603, scope.project.id=b360f1c130384ed8a57179e36d9b4f7d, user.id=4c6d5ebdee734763b519a59b5c6c836f) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:21.702485 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b652cb03-2822-445b-90fb-fa4836b2d975 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:21.703944 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b652cb03-2822-445b-90fb-fa4836b2d975 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:21.716832 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 133/262] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 13 23:34:21 2022] GET /identity/v3/role_assignments?user.id=4c6d5ebdee734763b519a59b5c6c836f&scope.project.id=b360f1c130384ed8a57179e36d9b4f7d&role.id=46deff0e06964626a5600c9641454603 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:21.736455 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 130/263] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 23:34:21.792487 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652cb03-2822-445b-90fb-fa4836b2d975 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:21.931306 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652cb03-2822-445b-90fb-fa4836b2d975 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:21.976643 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef7f24-f511-40d6-af98-cb0eb885e7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:21.977509 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef7f24-f511-40d6-af98-cb0eb885e7e3 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:21.977804 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef7f24-f511-40d6-af98-cb0eb885e7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:21.978087 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef7f24-f511-40d6-af98-cb0eb885e7e3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:21.997807 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdef7f24-f511-40d6-af98-cb0eb885e7e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:34:22.006136 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-cdef7f24-f511-40d6-af98-cb0eb885e7e3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 23:34:22.006136 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:22.006136 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:22.006136 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:22.006136 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:22.006136 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:22.006136 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:22.006136 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:22.006136 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:22.006136 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:22.006136 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:22.006136 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:22.006136 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:34:22.006136 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:34:22.006136 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:34:22.006136 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:34:22.007064 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:34:22.007064 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:34:22.007064 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:34:22.007064 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:34:22.007064 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:22.007064 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:22.007064 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:22.007064 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:22.007064 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:22.007064 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:22.007064 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:22.007064 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:22.007064 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:22.007064 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:22.007064 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:22.007064 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:22.007823 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:22.007823 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:22.007823 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:22.007823 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:22.007823 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:34:22.007823 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:34:22.007823 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:34:22.007823 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:34:22.007823 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:34:22.007823 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:34:22.007823 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 23:34:22.007823 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:34:22.012433 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 134/264] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jul 13 23:34:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:22.014114 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009d3d3-67d7-44bc-af9d-a98d7d4821cf None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:22.148065 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:22.157110 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009d3d3-67d7-44bc-af9d-a98d7d4821cf None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:22.197075 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328417e-5efb-4ca3-8795-cd05b8f01534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:22.197665 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328417e-5efb-4ca3-8795-cd05b8f01534 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:22.197950 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328417e-5efb-4ca3-8795-cd05b8f01534 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:22.198227 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328417e-5efb-4ca3-8795-cd05b8f01534 None admin] PATH_INFO: `/v3/roles` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:22.199053 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0328417e-5efb-4ca3-8795-cd05b8f01534 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:22.199366 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0328417e-5efb-4ca3-8795-cd05b8f01534 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:22.200757 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0328417e-5efb-4ca3-8795-cd05b8f01534 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:22.216801 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 131/265] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 13 23:34:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:22.222851 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef7f24-f511-40d6-af98-cb0eb885e7e3 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:22.239524 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:22.357771 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef7f24-f511-40d6-af98-cb0eb885e7e3 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:22.406883 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182896cc-a1d6-412f-bf0d-f98d4a25bf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:22.407771 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182896cc-a1d6-412f-bf0d-f98d4a25bf3e None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:22.408090 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182896cc-a1d6-412f-bf0d-f98d4a25bf3e None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:22.408329 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182896cc-a1d6-412f-bf0d-f98d4a25bf3e None admin] PATH_INFO: `/v3/users/4c6d5ebdee734763b519a59b5c6c836f` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:22.409638 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182896cc-a1d6-412f-bf0d-f98d4a25bf3e None admin] RBAC: Authorizing `identity:get_user(user_id=4c6d5ebdee734763b519a59b5c6c836f)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:22.411099 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182896cc-a1d6-412f-bf0d-f98d4a25bf3e None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:22.413191 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 135/266] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 13 23:34:22 2022] GET /identity/v3/users/4c6d5ebdee734763b519a59b5c6c836f => generated 283 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:22.419300 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328417e-5efb-4ca3-8795-cd05b8f01534 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:22.559660 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328417e-5efb-4ca3-8795-cd05b8f01534 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:22.608655 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0d9d0a-bfe1-49a7-b0a5-a2110fbbc43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:22.609340 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d9d0a-bfe1-49a7-b0a5-a2110fbbc43c None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:22.609623 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d9d0a-bfe1-49a7-b0a5-a2110fbbc43c None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:22.609899 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d9d0a-bfe1-49a7-b0a5-a2110fbbc43c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:22.640919 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:22.687723 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0d9d0a-bfe1-49a7-b0a5-a2110fbbc43c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:22.689599 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0d9d0a-bfe1-49a7-b0a5-a2110fbbc43c None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:22.791211 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 132/267] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 13 23:34:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 23:34:22.797379 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182896cc-a1d6-412f-bf0d-f98d4a25bf3e None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:22.934713 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:22.963719 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182896cc-a1d6-412f-bf0d-f98d4a25bf3e None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:22.990936 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce95b4f-6668-4bb4-9ef5-029c9299a67b None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:22.991262 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce95b4f-6668-4bb4-9ef5-029c9299a67b None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:22.991501 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce95b4f-6668-4bb4-9ef5-029c9299a67b None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:22.993358 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 133/268] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:23.002810 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ede80-3b22-4590-af1b-554c9849ad99 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:23.003369 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ede80-3b22-4590-af1b-554c9849ad99 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:23.003861 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ede80-3b22-4590-af1b-554c9849ad99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:23.010027 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc2ef4c-1b3d-4191-84e8-265a6d30f838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:23.012944 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2ef4c-1b3d-4191-84e8-265a6d30f838 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:23.013238 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2ef4c-1b3d-4191-84e8-265a6d30f838 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:23.013517 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2ef4c-1b3d-4191-84e8-265a6d30f838 None admin] PATH_INFO: `/v3/projects/b360f1c130384ed8a57179e36d9b4f7d` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:23.016129 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc2ef4c-1b3d-4191-84e8-265a6d30f838 None admin] RBAC: Authorizing `identity:get_project(project_id=b360f1c130384ed8a57179e36d9b4f7d)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:23.017619 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc2ef4c-1b3d-4191-84e8-265a6d30f838 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:23.021024 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 136/269] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 13 23:34:22 2022] GET /identity/v3/projects/b360f1c130384ed8a57179e36d9b4f7d => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:23.025789 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc2ef4c-1b3d-4191-84e8-265a6d30f838 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:23.045594 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-684ede80-3b22-4590-af1b-554c9849ad99 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:23.046806 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-684ede80-3b22-4590-af1b-554c9849ad99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:23.125315 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:23.147461 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 134/270] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:34:23.195569 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ede80-3b22-4590-af1b-554c9849ad99 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:23.214665 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc2ef4c-1b3d-4191-84e8-265a6d30f838 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:23.249520 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb831b-fa89-496e-8f8e-db2dc791a516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:23.250454 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb831b-fa89-496e-8f8e-db2dc791a516 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:23.250884 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb831b-fa89-496e-8f8e-db2dc791a516 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:23.251305 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb831b-fa89-496e-8f8e-db2dc791a516 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:23.252283 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fb831b-fa89-496e-8f8e-db2dc791a516 None admin] RBAC: Adding query filter params (role.id=a27ce0a47b0a4f9bac8c6e78d9da4278, scope.project.id=b360f1c130384ed8a57179e36d9b4f7d, user.id=4c6d5ebdee734763b519a59b5c6c836f) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:23.252739 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fb831b-fa89-496e-8f8e-db2dc791a516 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:23.254407 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fb831b-fa89-496e-8f8e-db2dc791a516 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:23.260892 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 137/271] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 13 23:34:23 2022] GET /identity/v3/role_assignments?user.id=4c6d5ebdee734763b519a59b5c6c836f&scope.project.id=b360f1c130384ed8a57179e36d9b4f7d&role.id=a27ce0a47b0a4f9bac8c6e78d9da4278 => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:23.375968 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ede80-3b22-4590-af1b-554c9849ad99 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:23.412689 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd5d2e-227f-4ebe-acea-0bc79dec656e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:23.413529 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd5d2e-227f-4ebe-acea-0bc79dec656e None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:23.413808 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd5d2e-227f-4ebe-acea-0bc79dec656e None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:23.414080 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd5d2e-227f-4ebe-acea-0bc79dec656e None admin] PATH_INFO: `/v3/roles/member` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:23.426328 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd5d2e-227f-4ebe-acea-0bc79dec656e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:34:23.435165 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-50cd5d2e-227f-4ebe-acea-0bc79dec656e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 23:34:23.435165 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:23.435165 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:23.435165 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:23.435165 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:23.435165 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:23.435165 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:23.435165 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:23.435165 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:23.435165 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:23.435165 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:23.435165 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:23.435165 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:34:23.435165 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:34:23.435165 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:34:23.435165 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:34:23.436117 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:34:23.436117 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:34:23.436117 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:34:23.436117 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:34:23.436117 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:23.436117 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:23.436117 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:23.436117 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:23.436117 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:23.436117 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:23.436117 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:23.436117 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:23.436117 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:23.436117 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:23.436117 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:23.436117 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:23.436947 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:23.436947 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:23.436947 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:23.436947 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:23.436947 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:34:23.436947 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:34:23.436947 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:34:23.436947 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:34:23.436947 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:34:23.436947 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:34:23.436947 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 23:34:23.436947 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:34:23.436947 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 135/272] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:34:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 23:34:23.444404 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb831b-fa89-496e-8f8e-db2dc791a516 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:23.471588 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:23.570931 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb831b-fa89-496e-8f8e-db2dc791a516 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:23.610396 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cab754-cfef-413c-9896-44cf41d671e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:23.611093 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cab754-cfef-413c-9896-44cf41d671e3 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:23.611374 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cab754-cfef-413c-9896-44cf41d671e3 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:23.611649 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cab754-cfef-413c-9896-44cf41d671e3 None admin] PATH_INFO: `/v3/roles` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:23.612413 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cab754-cfef-413c-9896-44cf41d671e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:23.612725 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cab754-cfef-413c-9896-44cf41d671e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:23.614184 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cab754-cfef-413c-9896-44cf41d671e3 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:23.625201 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 138/273] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 13 23:34:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:23.631618 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd5d2e-227f-4ebe-acea-0bc79dec656e None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:23.641897 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541301e-2aa2-45d1-bbb2-9c1bedc57cd0 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:23.642203 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541301e-2aa2-45d1-bbb2-9c1bedc57cd0 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:23.642465 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541301e-2aa2-45d1-bbb2-9c1bedc57cd0 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:23.644498 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 139/274] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:23.650958 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c31c1e-c40e-4c27-a11e-9c6ec68179ab None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:23.651240 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c31c1e-c40e-4c27-a11e-9c6ec68179ab None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:23.651520 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c31c1e-c40e-4c27-a11e-9c6ec68179ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:23.673525 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-b3c31c1e-c40e-4c27-a11e-9c6ec68179ab None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:23.674733 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-b3c31c1e-c40e-4c27-a11e-9c6ec68179ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:23.695860 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:23.759134 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:23.767152 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 140/275] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 23:34:23.780663 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd5d2e-227f-4ebe-acea-0bc79dec656e None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:23.802488 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c31c1e-c40e-4c27-a11e-9c6ec68179ab None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:23.824282 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c0ae39-b30b-414b-b7ea-3fd04cce3c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:23.825294 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c0ae39-b30b-414b-b7ea-3fd04cce3c3a None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:23.825582 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c0ae39-b30b-414b-b7ea-3fd04cce3c3a None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:23.825857 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c0ae39-b30b-414b-b7ea-3fd04cce3c3a None admin] PATH_INFO: `/v3/users/d5912c0cac8b4b3cbb8b1ce8f485b0af` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:23.840634 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c0ae39-b30b-414b-b7ea-3fd04cce3c3a None admin] RBAC: Authorizing `identity:get_user(user_id=d5912c0cac8b4b3cbb8b1ce8f485b0af)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:23.842154 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c0ae39-b30b-414b-b7ea-3fd04cce3c3a None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:23.844001 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 136/276] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 13 23:34:23 2022] GET /identity/v3/users/d5912c0cac8b4b3cbb8b1ce8f485b0af => generated 293 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:23.846174 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524a0d1-5443-4294-a7a1-68892802928a None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:23.846738 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524a0d1-5443-4294-a7a1-68892802928a None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:23.847017 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524a0d1-5443-4294-a7a1-68892802928a None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:23.848465 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 137/277] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:23.849631 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524a0d1-5443-4294-a7a1-68892802928a None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:23.913317 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c31c1e-c40e-4c27-a11e-9c6ec68179ab None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:23.947443 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b939a-c86a-4a31-b1d1-a46f04222c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:23.948241 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b939a-c86a-4a31-b1d1-a46f04222c13 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:23.948531 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b939a-c86a-4a31-b1d1-a46f04222c13 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:23.949421 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b939a-c86a-4a31-b1d1-a46f04222c13 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:23.950784 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3b939a-c86a-4a31-b1d1-a46f04222c13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:23.952236 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3b939a-c86a-4a31-b1d1-a46f04222c13 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:23.954042 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 141/278] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:34:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:34:23.959482 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83cfc2-9505-4784-bb0b-d9bc34213ec7 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:23.959782 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83cfc2-9505-4784-bb0b-d9bc34213ec7 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:23.959937 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524a0d1-5443-4294-a7a1-68892802928a None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:23.960091 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83cfc2-9505-4784-bb0b-d9bc34213ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:23.962499 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:23.977425 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-1d83cfc2-9505-4784-bb0b-d9bc34213ec7 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:23.978612 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-1d83cfc2-9505-4784-bb0b-d9bc34213ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:24.000114 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc64d36-68f0-4b98-af5c-2b6b8c3ff2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:24.000931 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc64d36-68f0-4b98-af5c-2b6b8c3ff2db None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:24.001218 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc64d36-68f0-4b98-af5c-2b6b8c3ff2db None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:24.001491 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc64d36-68f0-4b98-af5c-2b6b8c3ff2db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:24.002310 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc64d36-68f0-4b98-af5c-2b6b8c3ff2db None admin] RBAC: Adding query filter params (role.id=69842edf01cf43eb814bb066f9652f48, user.id=d5912c0cac8b4b3cbb8b1ce8f485b0af, scope.system=all) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:24.002624 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc64d36-68f0-4b98-af5c-2b6b8c3ff2db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:24.004049 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc64d36-68f0-4b98-af5c-2b6b8c3ff2db None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:24.009198 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 138/279] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Jul 13 23:34:23 2022] GET /identity/v3/role_assignments?user.id=d5912c0cac8b4b3cbb8b1ce8f485b0af&scope.system=all&role.id=69842edf01cf43eb814bb066f9652f48 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:24.013749 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc64d36-68f0-4b98-af5c-2b6b8c3ff2db None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:24.046650 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:24.053018 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 142/280] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:34:24.077907 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83cfc2-9505-4784-bb0b-d9bc34213ec7 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:24.148724 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc64d36-68f0-4b98-af5c-2b6b8c3ff2db None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:24.196267 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824f0d4b-3ff2-4911-82de-cad194fbfbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:24.196919 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f0d4b-3ff2-4911-82de-cad194fbfbaa None admin] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:24.197208 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f0d4b-3ff2-4911-82de-cad194fbfbaa None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:24.197486 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f0d4b-3ff2-4911-82de-cad194fbfbaa None admin] PATH_INFO: `/v3/users` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:24.198671 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824f0d4b-3ff2-4911-82de-cad194fbfbaa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:24.200899 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824f0d4b-3ff2-4911-82de-cad194fbfbaa None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:24.223420 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 139/281] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jul 13 23:34:24 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 23:34:24.232882 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83cfc2-9505-4784-bb0b-d9bc34213ec7 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:24.270112 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45496aee-e77a-433e-a43c-3b33a9b3abd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:24.270926 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45496aee-e77a-433e-a43c-3b33a9b3abd5 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:24.271268 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45496aee-e77a-433e-a43c-3b33a9b3abd5 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:24.271552 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45496aee-e77a-433e-a43c-3b33a9b3abd5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:24.285297 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45496aee-e77a-433e-a43c-3b33a9b3abd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:34:24.293455 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-45496aee-e77a-433e-a43c-3b33a9b3abd5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 23:34:24.293455 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:24.293455 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:24.293455 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:24.293455 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:24.293455 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:24.293455 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:24.293455 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:24.293455 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:24.293455 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:24.293455 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:24.293455 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:24.293455 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:34:24.293455 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:34:24.293455 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:34:24.293455 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:34:24.294435 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:34:24.294435 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:34:24.294435 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:34:24.294435 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:34:24.294435 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:24.294435 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:24.294435 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:24.294435 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:24.294435 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:24.294435 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:24.294435 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:24.294435 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:24.294435 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:24.294435 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:24.294435 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:24.294435 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:24.295221 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:24.295221 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:24.295221 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:24.295221 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:24.295221 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:34:24.295221 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:34:24.295221 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:34:24.295221 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:34:24.295221 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:34:24.295221 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:34:24.295221 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 23:34:24.295221 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:34:24.295837 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 143/282] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:34:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:24.302686 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824f0d4b-3ff2-4911-82de-cad194fbfbaa None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:24.334722 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:24.362583 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e65d9e-2669-4fd0-95d1-f07f8b0c32ea None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:24.363314 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e65d9e-2669-4fd0-95d1-f07f8b0c32ea None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:24.363803 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e65d9e-2669-4fd0-95d1-f07f8b0c32ea None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:24.366014 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 144/283] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:24.372373 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a9f8e-4dbb-4a62-8b3a-974443e9dd3f None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:24.373031 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a9f8e-4dbb-4a62-8b3a-974443e9dd3f None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:24.373634 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a9f8e-4dbb-4a62-8b3a-974443e9dd3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:24.393218 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-795a9f8e-4dbb-4a62-8b3a-974443e9dd3f None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:24.395039 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-795a9f8e-4dbb-4a62-8b3a-974443e9dd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:24.444286 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824f0d4b-3ff2-4911-82de-cad194fbfbaa None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:24.473240 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:24.490888 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 145/284] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 23:34:24.491460 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01140d02-06e9-4236-937a-66d428549b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:24.492136 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01140d02-06e9-4236-937a-66d428549b76 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:24.492422 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01140d02-06e9-4236-937a-66d428549b76 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:24.492701 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01140d02-06e9-4236-937a-66d428549b76 None admin] PATH_INFO: `/v3/roles` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:24.493478 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01140d02-06e9-4236-937a-66d428549b76 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:24.493786 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01140d02-06e9-4236-937a-66d428549b76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:24.495159 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01140d02-06e9-4236-937a-66d428549b76 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:24.504551 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 140/285] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 13 23:34:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:24.510183 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a9f8e-4dbb-4a62-8b3a-974443e9dd3f None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:24.519465 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01140d02-06e9-4236-937a-66d428549b76 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:24.643948 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:24.655670 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a9f8e-4dbb-4a62-8b3a-974443e9dd3f None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:24.657294 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01140d02-06e9-4236-937a-66d428549b76 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:24.693776 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4db64-ab67-45e8-bda1-35bbda7b38f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:24.694956 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4db64-ab67-45e8-bda1-35bbda7b38f3 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:24.695471 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4db64-ab67-45e8-bda1-35bbda7b38f3 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:24.695952 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4db64-ab67-45e8-bda1-35bbda7b38f3 None admin] PATH_INFO: `/v3/users/ae0d4ebcd6234ad5a9bd60727f7ac309` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:24.697376 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128421f-56ff-440d-b6aa-0ab0634444b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:24.697604 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f4db64-ab67-45e8-bda1-35bbda7b38f3 None admin] RBAC: Authorizing `identity:get_user(user_id=ae0d4ebcd6234ad5a9bd60727f7ac309)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:24.698345 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128421f-56ff-440d-b6aa-0ab0634444b3 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:24.699214 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128421f-56ff-440d-b6aa-0ab0634444b3 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:24.699776 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128421f-56ff-440d-b6aa-0ab0634444b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:24.700334 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f4db64-ab67-45e8-bda1-35bbda7b38f3 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:24.702498 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 146/286] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 13 23:34:24 2022] GET /identity/v3/users/ae0d4ebcd6234ad5a9bd60727f7ac309 => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:24.709054 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4db64-ab67-45e8-bda1-35bbda7b38f3 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:24.711921 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128421f-56ff-440d-b6aa-0ab0634444b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:34:24.721516 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-6128421f-56ff-440d-b6aa-0ab0634444b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 23:34:24.721516 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:24.721516 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:24.721516 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:24.721516 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:24.721516 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:24.721516 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:24.721516 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:24.721516 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:24.721516 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:24.721516 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:24.721516 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:24.721516 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:34:24.721516 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:34:24.721516 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:34:24.721516 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:34:24.722410 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:34:24.722410 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:34:24.722410 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:34:24.722410 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:34:24.722410 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:24.722410 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:24.722410 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:24.722410 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:24.722410 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:24.722410 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:24.722410 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:24.722410 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:24.722410 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:24.722410 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:24.722410 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:24.722410 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:24.723187 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:24.723187 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:24.723187 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:24.723187 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:24.723187 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:34:24.723187 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:34:24.723187 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:34:24.723187 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:34:24.723187 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:34:24.723187 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:34:24.723187 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 23:34:24.723187 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:34:24.723187 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 141/287] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:34:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 23:34:24.728955 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128421f-56ff-440d-b6aa-0ab0634444b3 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:24.775273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:24.843666 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4db64-ab67-45e8-bda1-35bbda7b38f3 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:24.850849 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128421f-56ff-440d-b6aa-0ab0634444b3 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:24.879729 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71210499-8cd6-4edc-a327-da45a6e37cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:24.880616 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71210499-8cd6-4edc-a327-da45a6e37cc0 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:24.881011 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71210499-8cd6-4edc-a327-da45a6e37cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:24.881268 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71210499-8cd6-4edc-a327-da45a6e37cc0 None admin] PATH_INFO: `/v3/projects/b360f1c130384ed8a57179e36d9b4f7d` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:24.882468 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71210499-8cd6-4edc-a327-da45a6e37cc0 None admin] RBAC: Authorizing `identity:get_project(project_id=b360f1c130384ed8a57179e36d9b4f7d)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:24.883909 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71210499-8cd6-4edc-a327-da45a6e37cc0 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:24.885808 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 147/288] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 13 23:34:24 2022] GET /identity/v3/projects/b360f1c130384ed8a57179e36d9b4f7d => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:24.896234 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a7e18-5e24-4713-84f2-8bb5f15364ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:24.896950 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a7e18-5e24-4713-84f2-8bb5f15364ed None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:24.897235 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a7e18-5e24-4713-84f2-8bb5f15364ed None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:24.897510 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a7e18-5e24-4713-84f2-8bb5f15364ed None admin] PATH_INFO: `/v3/roles` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:24.898260 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a7e18-5e24-4713-84f2-8bb5f15364ed None admin] RBAC: Adding query filter params (name=member) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:24.898563 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a7e18-5e24-4713-84f2-8bb5f15364ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:24.899939 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a7e18-5e24-4713-84f2-8bb5f15364ed None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:24.901748 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71210499-8cd6-4edc-a327-da45a6e37cc0 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:24.924074 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 142/289] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 13 23:34:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:24.929110 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a7e18-5e24-4713-84f2-8bb5f15364ed None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:24.945591 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:25.037846 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71210499-8cd6-4edc-a327-da45a6e37cc0 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:25.063174 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:25.090066 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846556ce-2f5a-466b-9045-7462b35909c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:25.091078 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846556ce-2f5a-466b-9045-7462b35909c1 None admin] REQUEST_METHOD: `PUT` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:25.091361 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846556ce-2f5a-466b-9045-7462b35909c1 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:25.091634 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846556ce-2f5a-466b-9045-7462b35909c1 None admin] PATH_INFO: `/v3/projects/b360f1c130384ed8a57179e36d9b4f7d/users/ae0d4ebcd6234ad5a9bd60727f7ac309/roles/ef94ce01ebc74f67b71913824c20fbe4` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:25.100310 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846556ce-2f5a-466b-9045-7462b35909c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=b360f1c130384ed8a57179e36d9b4f7d, user_id=ae0d4ebcd6234ad5a9bd60727f7ac309, role_id=ef94ce01ebc74f67b71913824c20fbe4)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:25.100310 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846556ce-2f5a-466b-9045-7462b35909c1 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:25.120306 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 148/290] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jul 13 23:34:24 2022] PUT /identity/v3/projects/b360f1c130384ed8a57179e36d9b4f7d/users/ae0d4ebcd6234ad5a9bd60727f7ac309/roles/ef94ce01ebc74f67b71913824c20fbe4 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 23:34:25.129186 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a7e18-5e24-4713-84f2-8bb5f15364ed None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:25.175736 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e98c3b-ccda-4bd9-9ba2-3a69a4643adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:25.176711 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e98c3b-ccda-4bd9-9ba2-3a69a4643adb None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:25.177024 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e98c3b-ccda-4bd9-9ba2-3a69a4643adb None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:25.177299 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e98c3b-ccda-4bd9-9ba2-3a69a4643adb None admin] PATH_INFO: `/v3/users/4fcaadc360784cf38ca97a477ad7597d` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:25.178616 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e98c3b-ccda-4bd9-9ba2-3a69a4643adb None admin] RBAC: Authorizing `identity:get_user(user_id=4fcaadc360784cf38ca97a477ad7597d)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:25.180155 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e98c3b-ccda-4bd9-9ba2-3a69a4643adb None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:25.182000 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 143/291] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 13 23:34:24 2022] GET /identity/v3/users/4fcaadc360784cf38ca97a477ad7597d => generated 297 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:34:25.194352 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846556ce-2f5a-466b-9045-7462b35909c1 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:25.325727 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846556ce-2f5a-466b-9045-7462b35909c1 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:25.367822 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8698159-e004-4100-955a-43a07c489bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:25.368477 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8698159-e004-4100-955a-43a07c489bba None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:25.368889 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8698159-e004-4100-955a-43a07c489bba None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:25.369170 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8698159-e004-4100-955a-43a07c489bba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:25.440465 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:25.469071 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8698159-e004-4100-955a-43a07c489bba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:25.470571 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8698159-e004-4100-955a-43a07c489bba None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:25.606990 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 149/292] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 13 23:34:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 23:34:25.617888 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e98c3b-ccda-4bd9-9ba2-3a69a4643adb None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:25.738820 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:25.766721 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e98c3b-ccda-4bd9-9ba2-3a69a4643adb None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:25.811856 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a356ebd-c8d0-4c7c-bd32-570138882785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:25.812729 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a356ebd-c8d0-4c7c-bd32-570138882785 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:25.813050 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a356ebd-c8d0-4c7c-bd32-570138882785 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:25.813325 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a356ebd-c8d0-4c7c-bd32-570138882785 None admin] PATH_INFO: `/v3/projects/b360f1c130384ed8a57179e36d9b4f7d` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:25.814506 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a356ebd-c8d0-4c7c-bd32-570138882785 None admin] RBAC: Authorizing `identity:get_project(project_id=b360f1c130384ed8a57179e36d9b4f7d)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:25.815936 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a356ebd-c8d0-4c7c-bd32-570138882785 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:25.817654 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 144/293] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 13 23:34:25 2022] GET /identity/v3/projects/b360f1c130384ed8a57179e36d9b4f7d => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:25.823446 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8698159-e004-4100-955a-43a07c489bba None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:25.958873 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:25.979579 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8698159-e004-4100-955a-43a07c489bba None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:26.025918 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396a32e-ba4a-4caf-a11c-9040594fdf29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:26.026570 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396a32e-ba4a-4caf-a11c-9040594fdf29 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:26.027426 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396a32e-ba4a-4caf-a11c-9040594fdf29 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:26.027704 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396a32e-ba4a-4caf-a11c-9040594fdf29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:26.028542 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d396a32e-ba4a-4caf-a11c-9040594fdf29 None admin] RBAC: Adding query filter params (role.id=69842edf01cf43eb814bb066f9652f48, scope.project.id=b360f1c130384ed8a57179e36d9b4f7d, user.id=4fcaadc360784cf38ca97a477ad7597d) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:26.028872 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d396a32e-ba4a-4caf-a11c-9040594fdf29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:26.030332 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d396a32e-ba4a-4caf-a11c-9040594fdf29 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:26.037113 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 150/294] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 13 23:34:25 2022] GET /identity/v3/role_assignments?user.id=4fcaadc360784cf38ca97a477ad7597d&scope.project.id=b360f1c130384ed8a57179e36d9b4f7d&role.id=69842edf01cf43eb814bb066f9652f48 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:26.723206 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c7454-ff10-4114-ba48-3d5c07701950 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:26.723731 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c7454-ff10-4114-ba48-3d5c07701950 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:26.723731 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c7454-ff10-4114-ba48-3d5c07701950 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:26.725279 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 145/295] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:26.731266 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab856af7-7899-4e49-ab69-2cd3e4ad1c61 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:26.732110 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab856af7-7899-4e49-ab69-2cd3e4ad1c61 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:26.732614 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab856af7-7899-4e49-ab69-2cd3e4ad1c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:26.750305 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-ab856af7-7899-4e49-ab69-2cd3e4ad1c61 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:26.751827 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-ab856af7-7899-4e49-ab69-2cd3e4ad1c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:26.824659 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 151/296] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:34:26.848194 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c7454-ff10-4114-ba48-3d5c07701950 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:26.963948 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c7454-ff10-4114-ba48-3d5c07701950 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:27.000776 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d3c2b-7565-4170-a0f1-298caa17e52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:27.001620 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d3c2b-7565-4170-a0f1-298caa17e52c None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:27.001905 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d3c2b-7565-4170-a0f1-298caa17e52c None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:27.002182 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d3c2b-7565-4170-a0f1-298caa17e52c None admin] PATH_INFO: `/v3/roles/member` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:27.013800 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d3c2b-7565-4170-a0f1-298caa17e52c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:34:27.021600 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-012d3c2b-7565-4170-a0f1-298caa17e52c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 23:34:27.021600 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:27.021600 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:27.021600 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:27.021600 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:27.021600 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:27.021600 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:27.021600 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:27.021600 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:27.021600 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:27.021600 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:27.021600 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:27.021600 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:34:27.021600 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:34:27.021600 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:34:27.021600 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:34:27.022469 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:34:27.022469 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:34:27.022469 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:34:27.022469 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:34:27.022469 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:27.022469 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:27.022469 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:27.022469 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:27.022469 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:27.022469 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:27.022469 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:27.022469 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:27.022469 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:27.022469 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:27.022469 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:27.022469 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:27.023307 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:27.023307 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:27.023307 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:27.023307 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:27.023307 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:34:27.023307 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:34:27.023307 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:34:27.023307 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:34:27.023307 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:34:27.023307 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:34:27.023307 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 23:34:27.023307 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:34:27.023307 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 146/297] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:34:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:27.030558 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab856af7-7899-4e49-ab69-2cd3e4ad1c61 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:27.108775 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:27.112147 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4d86d-b3e2-47dd-8533-db2dadf2f822 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:27.112556 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4d86d-b3e2-47dd-8533-db2dadf2f822 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:27.112860 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4d86d-b3e2-47dd-8533-db2dadf2f822 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:27.121431 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 147/298] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:27.122679 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57b46a-4750-4828-be6d-d47ff6f798c7 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:27.122964 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57b46a-4750-4828-be6d-d47ff6f798c7 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:27.123237 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57b46a-4750-4828-be6d-d47ff6f798c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:27.135948 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab856af7-7899-4e49-ab69-2cd3e4ad1c61 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:27.141179 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:27.143005 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-ee57b46a-4750-4828-be6d-d47ff6f798c7 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:27.144367 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-ee57b46a-4750-4828-be6d-d47ff6f798c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:27.173871 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859de89a-5dba-46ae-b6b1-8f4c21a73efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:27.174709 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859de89a-5dba-46ae-b6b1-8f4c21a73efc None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:27.175120 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859de89a-5dba-46ae-b6b1-8f4c21a73efc None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:27.175503 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859de89a-5dba-46ae-b6b1-8f4c21a73efc None admin] PATH_INFO: `/v3/roles` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:27.176382 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859de89a-5dba-46ae-b6b1-8f4c21a73efc None admin] RBAC: Adding query filter params (name=member) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:27.176801 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859de89a-5dba-46ae-b6b1-8f4c21a73efc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:27.178367 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859de89a-5dba-46ae-b6b1-8f4c21a73efc None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:27.189091 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 152/299] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 13 23:34:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:27.194876 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859de89a-5dba-46ae-b6b1-8f4c21a73efc None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:27.232950 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 148/300] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:34:27.251505 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57b46a-4750-4828-be6d-d47ff6f798c7 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:27.311101 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859de89a-5dba-46ae-b6b1-8f4c21a73efc None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:27.352579 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b2ad5-8442-446b-b8cb-a58baf3dd92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:27.353604 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b2ad5-8442-446b-b8cb-a58baf3dd92b None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:27.353959 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b2ad5-8442-446b-b8cb-a58baf3dd92b None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:27.354308 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b2ad5-8442-446b-b8cb-a58baf3dd92b None admin] PATH_INFO: `/v3/users/d5912c0cac8b4b3cbb8b1ce8f485b0af` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:27.355658 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439b2ad5-8442-446b-b8cb-a58baf3dd92b None admin] RBAC: Authorizing `identity:get_user(user_id=d5912c0cac8b4b3cbb8b1ce8f485b0af)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:27.357306 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439b2ad5-8442-446b-b8cb-a58baf3dd92b None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:27.363927 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 153/301] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 13 23:34:27 2022] GET /identity/v3/users/d5912c0cac8b4b3cbb8b1ce8f485b0af => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:34:27.364946 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b2ad5-8442-446b-b8cb-a58baf3dd92b None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:27.377030 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:27.384629 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57b46a-4750-4828-be6d-d47ff6f798c7 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:27.421708 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760061a0-4375-45a8-b2d1-5714808e36b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:27.422946 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760061a0-4375-45a8-b2d1-5714808e36b9 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:27.423231 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760061a0-4375-45a8-b2d1-5714808e36b9 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:27.423673 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760061a0-4375-45a8-b2d1-5714808e36b9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:27.425774 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:27.436717 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760061a0-4375-45a8-b2d1-5714808e36b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:34:27.444426 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-760061a0-4375-45a8-b2d1-5714808e36b9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 23:34:27.444426 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:27.444426 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:27.444426 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:27.444426 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:27.444426 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:27.444426 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:27.444426 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:27.444426 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:27.444426 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:27.444426 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:27.444426 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:27.444426 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:34:27.444426 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:34:27.444426 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:34:27.444426 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:34:27.445503 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:34:27.445503 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:34:27.445503 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:34:27.445503 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:34:27.445503 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:27.445503 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:27.445503 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:27.445503 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:27.445503 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:27.445503 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:27.445503 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:27.445503 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:27.445503 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:27.445503 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:27.445503 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:27.445503 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:27.452569 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:27.452569 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:27.452569 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:27.452569 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:27.452569 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:34:27.452569 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:34:27.452569 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:34:27.452569 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:34:27.452569 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:34:27.452569 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:34:27.452569 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 23:34:27.452569 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:34:27.452569 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 149/302] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:34:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 23:34:27.452569 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00cb34-4dc2-4462-8f58-8218d234c702 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:27.453306 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00cb34-4dc2-4462-8f58-8218d234c702 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:27.453306 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00cb34-4dc2-4462-8f58-8218d234c702 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:27.453306 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 150/303] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:27.455424 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5031030-4b59-49e7-8ddd-51e483c7ce6c None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:27.455717 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5031030-4b59-49e7-8ddd-51e483c7ce6c None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:27.455997 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5031030-4b59-49e7-8ddd-51e483c7ce6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:27.473270 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-a5031030-4b59-49e7-8ddd-51e483c7ce6c None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:27.474441 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-a5031030-4b59-49e7-8ddd-51e483c7ce6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:27.478384 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b2ad5-8442-446b-b8cb-a58baf3dd92b None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:27.517747 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7d57d-fdf9-4730-bcef-10e303112370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:27.519073 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7d57d-fdf9-4730-bcef-10e303112370 None admin] REQUEST_METHOD: `PUT` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:27.519371 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7d57d-fdf9-4730-bcef-10e303112370 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:27.521000 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7d57d-fdf9-4730-bcef-10e303112370 None admin] PATH_INFO: `/v3/system/users/d5912c0cac8b4b3cbb8b1ce8f485b0af/roles/69842edf01cf43eb814bb066f9652f48` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:27.522677 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb7d57d-fdf9-4730-bcef-10e303112370 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d5912c0cac8b4b3cbb8b1ce8f485b0af, role_id=69842edf01cf43eb814bb066f9652f48)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:27.524272 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb7d57d-fdf9-4730-bcef-10e303112370 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:27.534299 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 154/304] 10.222.0.16 () {58 vars in 1334 bytes} [Wed Jul 13 23:34:27 2022] PUT /identity/v3/system/users/d5912c0cac8b4b3cbb8b1ce8f485b0af/roles/69842edf01cf43eb814bb066f9652f48 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 23:34:27.545912 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7d57d-fdf9-4730-bcef-10e303112370 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:27.565284 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 151/305] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 23:34:27.581767 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5031030-4b59-49e7-8ddd-51e483c7ce6c None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:27.645199 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:27.686651 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7d57d-fdf9-4730-bcef-10e303112370 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:27.698435 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5031030-4b59-49e7-8ddd-51e483c7ce6c None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:27.724971 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:27.733090 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44df3e-2ba2-45b5-926f-47ce8db808f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:27.733589 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44df3e-2ba2-45b5-926f-47ce8db808f3 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:27.733589 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44df3e-2ba2-45b5-926f-47ce8db808f3 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:27.733727 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44df3e-2ba2-45b5-926f-47ce8db808f3 None admin] PATH_INFO: `/v3/roles` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:27.734494 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b44df3e-2ba2-45b5-926f-47ce8db808f3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:27.734807 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b44df3e-2ba2-45b5-926f-47ce8db808f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:27.736234 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b44df3e-2ba2-45b5-926f-47ce8db808f3 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:27.738566 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd74b7-e4db-4baa-b47f-98a6095a94d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:27.738566 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd74b7-e4db-4baa-b47f-98a6095a94d4 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:27.738566 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd74b7-e4db-4baa-b47f-98a6095a94d4 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:27.738566 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd74b7-e4db-4baa-b47f-98a6095a94d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:27.739693 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd74b7-e4db-4baa-b47f-98a6095a94d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:27.741757 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd74b7-e4db-4baa-b47f-98a6095a94d4 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:27.743023 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 152/306] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:34:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:34:27.748882 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 155/307] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 13 23:34:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:27.750035 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd74b7-e4db-4baa-b47f-98a6095a94d4 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:27.751358 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44df3e-2ba2-45b5-926f-47ce8db808f3 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:27.864893 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44df3e-2ba2-45b5-926f-47ce8db808f3 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:27.865303 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd74b7-e4db-4baa-b47f-98a6095a94d4 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:27.903821 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1bd9c-0a0f-4c8f-a935-2998b11fc98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:27.904007 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930ed5f-cb2f-452f-b9c7-cd189d16a417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:27.904612 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930ed5f-cb2f-452f-b9c7-cd189d16a417 None admin] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:27.904722 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1bd9c-0a0f-4c8f-a935-2998b11fc98d None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:27.904928 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930ed5f-cb2f-452f-b9c7-cd189d16a417 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:27.905026 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1bd9c-0a0f-4c8f-a935-2998b11fc98d None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:27.905208 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930ed5f-cb2f-452f-b9c7-cd189d16a417 None admin] PATH_INFO: `/v3/groups` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:27.905300 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1bd9c-0a0f-4c8f-a935-2998b11fc98d None admin] PATH_INFO: `/v3/users/683b9d9c3b7d4e619b345c38b1b902b9` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:27.905897 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930ed5f-cb2f-452f-b9c7-cd189d16a417 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:27.907336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930ed5f-cb2f-452f-b9c7-cd189d16a417 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:27.907507 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:27.921920 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa1bd9c-0a0f-4c8f-a935-2998b11fc98d None admin] RBAC: Authorizing `identity:get_user(user_id=683b9d9c3b7d4e619b345c38b1b902b9)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:27.923390 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa1bd9c-0a0f-4c8f-a935-2998b11fc98d None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:27.930301 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 153/308] 10.222.0.16 () {60 vars in 1134 bytes} [Wed Jul 13 23:34:27 2022] POST /identity/v3/groups => generated 229 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 23:34:27.930301 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d5020-6914-4981-b8de-42437d7d28a0 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:27.930301 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d5020-6914-4981-b8de-42437d7d28a0 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:27.930589 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 156/309] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 13 23:34:27 2022] GET /identity/v3/users/683b9d9c3b7d4e619b345c38b1b902b9 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:34:27.930682 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d5020-6914-4981-b8de-42437d7d28a0 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:27.930682 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 154/310] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:27.931620 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1bd9c-0a0f-4c8f-a935-2998b11fc98d None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:27.932679 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc1630-e6f4-46ca-8084-57ae514cb539 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:27.933035 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc1630-e6f4-46ca-8084-57ae514cb539 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:27.935240 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc1630-e6f4-46ca-8084-57ae514cb539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:27.952857 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-96bc1630-e6f4-46ca-8084-57ae514cb539 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:27.954068 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-96bc1630-e6f4-46ca-8084-57ae514cb539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:28.012203 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:28.053092 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 155/311] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 23:34:28.073158 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1bd9c-0a0f-4c8f-a935-2998b11fc98d None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:28.077754 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc1630-e6f4-46ca-8084-57ae514cb539 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:28.124581 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3296bec-4765-4d88-8b14-5ff27cbdf3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:28.125679 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3296bec-4765-4d88-8b14-5ff27cbdf3a2 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:28.126162 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3296bec-4765-4d88-8b14-5ff27cbdf3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:28.127113 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3296bec-4765-4d88-8b14-5ff27cbdf3a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:28.128184 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3296bec-4765-4d88-8b14-5ff27cbdf3a2 None admin] RBAC: Adding query filter params (role.id=ef94ce01ebc74f67b71913824c20fbe4, user.id=683b9d9c3b7d4e619b345c38b1b902b9, scope.system=all) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:28.129078 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3296bec-4765-4d88-8b14-5ff27cbdf3a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:28.131207 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3296bec-4765-4d88-8b14-5ff27cbdf3a2 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:28.144938 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 157/312] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Jul 13 23:34:27 2022] GET /identity/v3/role_assignments?user.id=683b9d9c3b7d4e619b345c38b1b902b9&scope.system=all&role.id=ef94ce01ebc74f67b71913824c20fbe4 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:28.200965 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc1630-e6f4-46ca-8084-57ae514cb539 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:28.242994 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d52648-4293-4515-8790-7926d715e521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:28.243819 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d52648-4293-4515-8790-7926d715e521 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:28.244098 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d52648-4293-4515-8790-7926d715e521 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:28.244370 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d52648-4293-4515-8790-7926d715e521 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:28.257232 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d52648-4293-4515-8790-7926d715e521 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:34:28.265639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-48d52648-4293-4515-8790-7926d715e521 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 23:34:28.265639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:28.265639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:28.265639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:28.265639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:28.265639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:28.265639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:28.265639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:28.265639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:28.265639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:28.265639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:28.265639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:28.265639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:34:28.265639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:34:28.265639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:34:28.265639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:34:28.266561 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:34:28.266561 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:34:28.266561 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:34:28.266561 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:34:28.266561 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:28.266561 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:28.266561 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:28.266561 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:28.266561 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:28.266561 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:28.266561 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:28.266561 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:28.266561 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:28.266561 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:28.266561 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:28.266561 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:28.267349 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:28.267349 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:28.267349 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:28.267349 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:28.267349 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:34:28.267349 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:34:28.267349 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:34:28.267349 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:34:28.267349 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:34:28.267349 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:34:28.267349 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 23:34:28.267349 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:34:28.267349 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 156/313] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:34:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 23:34:28.274535 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3296bec-4765-4d88-8b14-5ff27cbdf3a2 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:28.343474 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:28.390432 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3296bec-4765-4d88-8b14-5ff27cbdf3a2 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:28.426275 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c847c36-6e50-41e9-b4ac-e507d422edd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:28.426945 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c847c36-6e50-41e9-b4ac-e507d422edd6 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:28.427229 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c847c36-6e50-41e9-b4ac-e507d422edd6 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:28.427505 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c847c36-6e50-41e9-b4ac-e507d422edd6 None admin] PATH_INFO: `/v3/roles` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:28.428240 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c847c36-6e50-41e9-b4ac-e507d422edd6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:28.428544 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c847c36-6e50-41e9-b4ac-e507d422edd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:28.429954 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c847c36-6e50-41e9-b4ac-e507d422edd6 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:28.439060 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 158/314] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 13 23:34:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:28.445962 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d52648-4293-4515-8790-7926d715e521 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:28.496811 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:28.561327 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d52648-4293-4515-8790-7926d715e521 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:28.596320 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b970d-b345-45a4-9840-d354c8ce76ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:28.597223 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b970d-b345-45a4-9840-d354c8ce76ef None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:28.597513 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b970d-b345-45a4-9840-d354c8ce76ef None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:28.597789 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b970d-b345-45a4-9840-d354c8ce76ef None admin] PATH_INFO: `/v3/users/ae0d4ebcd6234ad5a9bd60727f7ac309` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:28.599044 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b970d-b345-45a4-9840-d354c8ce76ef None admin] RBAC: Authorizing `identity:get_user(user_id=ae0d4ebcd6234ad5a9bd60727f7ac309)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:28.600495 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b970d-b345-45a4-9840-d354c8ce76ef None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:28.602426 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 157/315] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 13 23:34:28 2022] GET /identity/v3/users/ae0d4ebcd6234ad5a9bd60727f7ac309 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:28.607857 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c847c36-6e50-41e9-b4ac-e507d422edd6 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:28.723189 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c847c36-6e50-41e9-b4ac-e507d422edd6 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:28.742095 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:28.761569 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd603358-ca8c-45b5-a193-65511de97a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:28.762203 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd603358-ca8c-45b5-a193-65511de97a82 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:28.762492 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd603358-ca8c-45b5-a193-65511de97a82 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:28.763088 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd603358-ca8c-45b5-a193-65511de97a82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:28.836682 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd603358-ca8c-45b5-a193-65511de97a82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:28.838182 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd603358-ca8c-45b5-a193-65511de97a82 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:28.945173 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 159/316] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 13 23:34:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 23:34:28.951258 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b970d-b345-45a4-9840-d354c8ce76ef None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:29.053163 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b970d-b345-45a4-9840-d354c8ce76ef None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:29.063617 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:29.088478 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac0e438-e09a-4267-97a7-38018d504926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:29.090032 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0e438-e09a-4267-97a7-38018d504926 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:29.090328 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0e438-e09a-4267-97a7-38018d504926 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:29.090600 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0e438-e09a-4267-97a7-38018d504926 None admin] PATH_INFO: `/v3/projects/b360f1c130384ed8a57179e36d9b4f7d` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:29.091789 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac0e438-e09a-4267-97a7-38018d504926 None admin] RBAC: Authorizing `identity:get_project(project_id=b360f1c130384ed8a57179e36d9b4f7d)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:29.093265 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac0e438-e09a-4267-97a7-38018d504926 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:29.095236 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 158/317] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 13 23:34:28 2022] GET /identity/v3/projects/b360f1c130384ed8a57179e36d9b4f7d => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:29.101142 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd603358-ca8c-45b5-a193-65511de97a82 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:29.120221 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:29.207238 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd603358-ca8c-45b5-a193-65511de97a82 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:29.242183 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691f948-8e70-44bf-9eb9-dffad2484c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:29.243179 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691f948-8e70-44bf-9eb9-dffad2484c85 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:29.243657 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691f948-8e70-44bf-9eb9-dffad2484c85 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:29.244145 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691f948-8e70-44bf-9eb9-dffad2484c85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:29.245222 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691f948-8e70-44bf-9eb9-dffad2484c85 None admin] RBAC: Adding query filter params (role.id=ef94ce01ebc74f67b71913824c20fbe4, scope.project.id=b360f1c130384ed8a57179e36d9b4f7d, user.id=ae0d4ebcd6234ad5a9bd60727f7ac309) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:29.245840 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691f948-8e70-44bf-9eb9-dffad2484c85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:29.247467 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691f948-8e70-44bf-9eb9-dffad2484c85 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:29.254547 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 160/318] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 13 23:34:29 2022] GET /identity/v3/role_assignments?user.id=ae0d4ebcd6234ad5a9bd60727f7ac309&scope.project.id=b360f1c130384ed8a57179e36d9b4f7d&role.id=ef94ce01ebc74f67b71913824c20fbe4 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:29.921946 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d959bda-6094-4625-8795-2345b06d6ef6 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:29.922318 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d959bda-6094-4625-8795-2345b06d6ef6 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:29.922523 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d959bda-6094-4625-8795-2345b06d6ef6 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:29.924045 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 159/319] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:29.928970 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92ef33-280e-4bce-83a4-d09f5d8632df None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:29.929426 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92ef33-280e-4bce-83a4-d09f5d8632df None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:29.929602 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92ef33-280e-4bce-83a4-d09f5d8632df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:29.946591 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-1a92ef33-280e-4bce-83a4-d09f5d8632df None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:29.947798 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-1a92ef33-280e-4bce-83a4-d09f5d8632df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:30.018569 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 161/320] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:34:30.043956 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d959bda-6094-4625-8795-2345b06d6ef6 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:30.150570 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d959bda-6094-4625-8795-2345b06d6ef6 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:30.186806 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a704159-f407-4a09-8f4e-9a6b6529673b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:30.187529 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a704159-f407-4a09-8f4e-9a6b6529673b None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:30.187814 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a704159-f407-4a09-8f4e-9a6b6529673b None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:30.188092 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a704159-f407-4a09-8f4e-9a6b6529673b None admin] PATH_INFO: `/v3/roles/member` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:30.198307 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a704159-f407-4a09-8f4e-9a6b6529673b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:34:30.207334 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-5a704159-f407-4a09-8f4e-9a6b6529673b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 23:34:30.207334 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:30.207334 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:30.207334 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:30.207334 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:30.207334 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:30.207334 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:30.207334 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:30.207334 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:30.207334 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:30.207334 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:30.207334 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:30.207334 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:34:30.207334 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:34:30.207334 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:34:30.207334 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:34:30.208240 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:34:30.208240 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:34:30.208240 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:34:30.208240 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:34:30.208240 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:30.208240 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:30.208240 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:30.208240 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:30.208240 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:30.208240 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:30.208240 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:30.208240 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:30.208240 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:30.208240 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:30.208240 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:30.208240 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:30.209490 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:30.209490 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:30.209490 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:30.209490 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:30.209490 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:34:30.209490 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:34:30.209490 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:34:30.209490 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:34:30.209490 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:34:30.209490 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:34:30.209490 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 23:34:30.209490 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:34:30.210443 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 160/321] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:34:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:30.215287 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92ef33-280e-4bce-83a4-d09f5d8632df None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:30.231265 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:30.323161 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92ef33-280e-4bce-83a4-d09f5d8632df None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:30.358721 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6b173-9431-471f-b00f-5f6de03730f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:30.359391 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6b173-9431-471f-b00f-5f6de03730f7 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:30.359678 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6b173-9431-471f-b00f-5f6de03730f7 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:30.359957 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6b173-9431-471f-b00f-5f6de03730f7 None admin] PATH_INFO: `/v3/roles` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:30.360700 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e6b173-9431-471f-b00f-5f6de03730f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:30.361055 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e6b173-9431-471f-b00f-5f6de03730f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:30.362430 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e6b173-9431-471f-b00f-5f6de03730f7 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:30.375342 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 162/322] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 13 23:34:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:30.376699 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a704159-f407-4a09-8f4e-9a6b6529673b None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:30.392156 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67fa9b-8e5f-4730-8735-bceb012a5cc0 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:30.392471 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67fa9b-8e5f-4730-8735-bceb012a5cc0 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:30.392733 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67fa9b-8e5f-4730-8735-bceb012a5cc0 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:30.394499 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 163/323] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 23:34:30.399847 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef448bee-25d7-46c8-b509-f827d392a7dc None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:30.400133 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef448bee-25d7-46c8-b509-f827d392a7dc None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:30.400412 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef448bee-25d7-46c8-b509-f827d392a7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:30.420447 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-ef448bee-25d7-46c8-b509-f827d392a7dc None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:30.421728 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-ef448bee-25d7-46c8-b509-f827d392a7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:30.426424 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:30.493902 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a704159-f407-4a09-8f4e-9a6b6529673b None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:30.499484 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 164/324] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 23:34:30.524376 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef448bee-25d7-46c8-b509-f827d392a7dc None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:30.528764 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:30.535962 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514661c-c75f-4b62-9ef9-02a778e51f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:30.536800 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514661c-c75f-4b62-9ef9-02a778e51f90 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:30.537113 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514661c-c75f-4b62-9ef9-02a778e51f90 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:30.537383 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514661c-c75f-4b62-9ef9-02a778e51f90 None admin] PATH_INFO: `/v3/users/d5912c0cac8b4b3cbb8b1ce8f485b0af` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:30.541195 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9514661c-c75f-4b62-9ef9-02a778e51f90 None admin] RBAC: Authorizing `identity:get_user(user_id=d5912c0cac8b4b3cbb8b1ce8f485b0af)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:30.543495 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9514661c-c75f-4b62-9ef9-02a778e51f90 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:30.544381 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 161/325] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 13 23:34:30 2022] GET /identity/v3/users/d5912c0cac8b4b3cbb8b1ce8f485b0af => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:30.550303 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514661c-c75f-4b62-9ef9-02a778e51f90 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:30.638129 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef448bee-25d7-46c8-b509-f827d392a7dc None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:30.653740 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514661c-c75f-4b62-9ef9-02a778e51f90 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:30.660565 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:30.673216 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b69aa-2059-43f9-8049-903688333465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:30.674014 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b69aa-2059-43f9-8049-903688333465 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:30.674302 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b69aa-2059-43f9-8049-903688333465 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:30.674582 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b69aa-2059-43f9-8049-903688333465 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:30.675738 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579b69aa-2059-43f9-8049-903688333465 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:30.677227 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579b69aa-2059-43f9-8049-903688333465 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:30.678832 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 165/326] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:34:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:30.679992 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21f1c4-6e56-4ff0-8bb4-f3325d94f4f8 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:30.680286 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21f1c4-6e56-4ff0-8bb4-f3325d94f4f8 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:30.680570 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21f1c4-6e56-4ff0-8bb4-f3325d94f4f8 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:30.682070 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 166/327] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:30.684333 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f21f1c4-6e56-4ff0-8bb4-f3325d94f4f8 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:30.688021 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb40ccb-fa24-43a7-af03-d40eb119a5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:30.688675 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb40ccb-fa24-43a7-af03-d40eb119a5ff None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:30.688986 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb40ccb-fa24-43a7-af03-d40eb119a5ff None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:30.689265 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb40ccb-fa24-43a7-af03-d40eb119a5ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:30.690087 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb40ccb-fa24-43a7-af03-d40eb119a5ff None admin] RBAC: Adding query filter params (role.id=69842edf01cf43eb814bb066f9652f48, user.id=d5912c0cac8b4b3cbb8b1ce8f485b0af, scope.system=all) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:30.690400 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb40ccb-fa24-43a7-af03-d40eb119a5ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:30.691827 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb40ccb-fa24-43a7-af03-d40eb119a5ff None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:30.703992 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 162/328] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Jul 13 23:34:30 2022] GET /identity/v3/role_assignments?user.id=d5912c0cac8b4b3cbb8b1ce8f485b0af&scope.system=all&role.id=69842edf01cf43eb814bb066f9652f48 => generated 510 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:30.705216 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98c565-8506-439b-aed9-9b9ff8ba5da1 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:30.705507 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98c565-8506-439b-aed9-9b9ff8ba5da1 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:30.705784 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98c565-8506-439b-aed9-9b9ff8ba5da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:30.723475 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-ae98c565-8506-439b-aed9-9b9ff8ba5da1 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:30.725770 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-ae98c565-8506-439b-aed9-9b9ff8ba5da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:30.774089 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:30.806600 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 163/329] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:34:30.812651 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f21f1c4-6e56-4ff0-8bb4-f3325d94f4f8 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:30.830581 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae98c565-8506-439b-aed9-9b9ff8ba5da1 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:30.856627 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5fd62-b4b3-467c-a6da-6a8280d15b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:30.857345 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5fd62-b4b3-467c-a6da-6a8280d15b5a None admin] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:30.857625 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5fd62-b4b3-467c-a6da-6a8280d15b5a None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:30.857906 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5fd62-b4b3-467c-a6da-6a8280d15b5a None admin] PATH_INFO: `/v3/groups` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:30.858608 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5fd62-b4b3-467c-a6da-6a8280d15b5a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:30.860085 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5fd62-b4b3-467c-a6da-6a8280d15b5a None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:30.889020 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 167/330] 10.222.0.16 () {60 vars in 1134 bytes} [Wed Jul 13 23:34:30 2022] POST /identity/v3/groups => generated 226 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 23:34:30.947946 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:30.957958 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae98c565-8506-439b-aed9-9b9ff8ba5da1 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:30.999703 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd88bd-4b33-4dd4-97de-01e22bdc9de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:31.000520 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd88bd-4b33-4dd4-97de-01e22bdc9de3 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:31.000804 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd88bd-4b33-4dd4-97de-01e22bdc9de3 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:31.001107 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd88bd-4b33-4dd4-97de-01e22bdc9de3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:31.013826 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bd88bd-4b33-4dd4-97de-01e22bdc9de3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:34:31.021774 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-17bd88bd-4b33-4dd4-97de-01e22bdc9de3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 23:34:31.021774 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:31.021774 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:31.021774 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:31.021774 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:31.021774 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:31.021774 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:31.021774 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:31.021774 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:31.021774 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:31.021774 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:31.021774 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:31.021774 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:34:31.021774 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:34:31.021774 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:34:31.021774 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:34:31.022716 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:34:31.022716 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:34:31.022716 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:34:31.022716 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:34:31.022716 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:31.022716 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:31.022716 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:31.022716 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:31.022716 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:31.022716 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:31.022716 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:31.022716 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:31.022716 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:31.022716 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:31.022716 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:31.022716 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:31.023708 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:31.023708 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:31.023708 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:31.023708 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:31.023708 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:34:31.023708 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:34:31.023708 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:34:31.023708 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:34:31.023708 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:34:31.023708 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:34:31.023708 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 23:34:31.023708 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:34:31.023708 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 164/331] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:34:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 23:34:31.029693 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5fd62-b4b3-467c-a6da-6a8280d15b5a None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:31.133329 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5fd62-b4b3-467c-a6da-6a8280d15b5a None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:31.166865 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:31.173505 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e033aa-7497-4ae8-8d9b-53ec699d2e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:31.174611 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e033aa-7497-4ae8-8d9b-53ec699d2e27 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:31.175078 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e033aa-7497-4ae8-8d9b-53ec699d2e27 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:31.175537 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e033aa-7497-4ae8-8d9b-53ec699d2e27 None admin] PATH_INFO: `/v3/roles` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:31.176290 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e033aa-7497-4ae8-8d9b-53ec699d2e27 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:31.176598 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e033aa-7497-4ae8-8d9b-53ec699d2e27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:31.178009 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e033aa-7497-4ae8-8d9b-53ec699d2e27 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:31.187222 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 168/332] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 13 23:34:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:31.192388 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd88bd-4b33-4dd4-97de-01e22bdc9de3 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:31.306256 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd88bd-4b33-4dd4-97de-01e22bdc9de3 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:31.344075 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e6f222-4e05-4b3d-b428-1baa2244ae3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:31.345097 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6f222-4e05-4b3d-b428-1baa2244ae3a None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:31.345385 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6f222-4e05-4b3d-b428-1baa2244ae3a None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:31.345661 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6f222-4e05-4b3d-b428-1baa2244ae3a None admin] PATH_INFO: `/v3/users/683b9d9c3b7d4e619b345c38b1b902b9` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:31.347011 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e6f222-4e05-4b3d-b428-1baa2244ae3a None admin] RBAC: Authorizing `identity:get_user(user_id=683b9d9c3b7d4e619b345c38b1b902b9)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:31.348462 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e6f222-4e05-4b3d-b428-1baa2244ae3a None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:31.350486 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 165/333] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 13 23:34:31 2022] GET /identity/v3/users/683b9d9c3b7d4e619b345c38b1b902b9 => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:31.355687 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e033aa-7497-4ae8-8d9b-53ec699d2e27 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:31.475770 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e033aa-7497-4ae8-8d9b-53ec699d2e27 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:31.513478 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99866d6a-0fbd-4c77-98c9-dae73b5bc6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:31.514739 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99866d6a-0fbd-4c77-98c9-dae73b5bc6c8 None admin] REQUEST_METHOD: `PUT` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:31.515243 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99866d6a-0fbd-4c77-98c9-dae73b5bc6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:31.515727 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99866d6a-0fbd-4c77-98c9-dae73b5bc6c8 None admin] PATH_INFO: `/v3/system/users/683b9d9c3b7d4e619b345c38b1b902b9/roles/ef94ce01ebc74f67b71913824c20fbe4` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:31.517483 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99866d6a-0fbd-4c77-98c9-dae73b5bc6c8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=683b9d9c3b7d4e619b345c38b1b902b9, role_id=ef94ce01ebc74f67b71913824c20fbe4)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:31.519345 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99866d6a-0fbd-4c77-98c9-dae73b5bc6c8 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:31.533726 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 169/334] 10.222.0.16 () {58 vars in 1334 bytes} [Wed Jul 13 23:34:31 2022] PUT /identity/v3/system/users/683b9d9c3b7d4e619b345c38b1b902b9/roles/ef94ce01ebc74f67b71913824c20fbe4 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 23:34:33.961524 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099cc4f-d789-4722-9a02-e0a2f2472907 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:33.962571 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099cc4f-d789-4722-9a02-e0a2f2472907 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:33.963076 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099cc4f-d789-4722-9a02-e0a2f2472907 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:33.965686 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 166/335] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:33.973724 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ecb50-5582-4474-9221-b266c0ba63f9 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:33.974660 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ecb50-5582-4474-9221-b266c0ba63f9 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:33.975162 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ecb50-5582-4474-9221-b266c0ba63f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:33.999941 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-b44ecb50-5582-4474-9221-b266c0ba63f9 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:34.001527 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-b44ecb50-5582-4474-9221-b266c0ba63f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:34.080272 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:34.099893 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 170/336] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:34:34.147169 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d099cc4f-d789-4722-9a02-e0a2f2472907 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:34.179630 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:34.282605 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d099cc4f-d789-4722-9a02-e0a2f2472907 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:34.331488 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d41ff9-b40a-482a-8dd5-646e4e35687f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:34.332681 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d41ff9-b40a-482a-8dd5-646e4e35687f None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:34.333291 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d41ff9-b40a-482a-8dd5-646e4e35687f None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:34.333782 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d41ff9-b40a-482a-8dd5-646e4e35687f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:34.345831 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d41ff9-b40a-482a-8dd5-646e4e35687f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:34:34.358626 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-b7d41ff9-b40a-482a-8dd5-646e4e35687f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 23:34:34.358626 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:34.358626 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:34.358626 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:34.358626 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:34.358626 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:34.358626 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:34.358626 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:34.358626 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:34.358626 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:34.358626 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:34.358626 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:34.358626 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:34:34.358626 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:34:34.358626 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:34:34.358626 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:34:34.359533 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:34:34.359533 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:34:34.359533 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:34:34.359533 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:34:34.359533 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:34.359533 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:34.359533 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:34.359533 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:34.359533 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:34.359533 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:34.359533 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:34.359533 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:34.359533 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:34.359533 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:34.359533 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:34.359533 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:34.360311 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:34.360311 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:34.360311 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:34.360311 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:34.360311 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:34:34.360311 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:34:34.360311 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:34:34.360311 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:34:34.360311 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:34:34.360311 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:34:34.360311 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 23:34:34.360311 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:34:34.363138 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 167/337] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jul 13 23:34:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:34.368507 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ecb50-5582-4474-9221-b266c0ba63f9 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:34.486245 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ecb50-5582-4474-9221-b266c0ba63f9 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:34.486931 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67559b-b4ec-49af-a033-0310c7e74469 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:34.487217 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67559b-b4ec-49af-a033-0310c7e74469 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:34.487494 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67559b-b4ec-49af-a033-0310c7e74469 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:34.489131 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 168/338] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 23:34:34.496089 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f82f3-f497-4dc4-bf8b-4f0e53294b85 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:34.496376 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f82f3-f497-4dc4-bf8b-4f0e53294b85 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:34.496660 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f82f3-f497-4dc4-bf8b-4f0e53294b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:34.536734 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-a02f82f3-f497-4dc4-bf8b-4f0e53294b85 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:34.537910 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-a02f82f3-f497-4dc4-bf8b-4f0e53294b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:34.538317 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd2984-3d8c-44e6-8712-ddea23587e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:34.539258 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd2984-3d8c-44e6-8712-ddea23587e47 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:34.539767 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd2984-3d8c-44e6-8712-ddea23587e47 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:34.544690 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd2984-3d8c-44e6-8712-ddea23587e47 None admin] PATH_INFO: `/v3/roles` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:34.545838 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd2984-3d8c-44e6-8712-ddea23587e47 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:34.546442 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd2984-3d8c-44e6-8712-ddea23587e47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:34.548168 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd2984-3d8c-44e6-8712-ddea23587e47 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:34.560131 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 171/339] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 13 23:34:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:34.562513 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85d4b5-2e93-414e-a33e-8555771aa7e5 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:34.563068 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85d4b5-2e93-414e-a33e-8555771aa7e5 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:34.563669 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85d4b5-2e93-414e-a33e-8555771aa7e5 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:34.565621 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 172/340] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:34.567231 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85d4b5-2e93-414e-a33e-8555771aa7e5 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:34.637852 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:34.718358 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 169/341] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:34:34.721523 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b3568-a887-4412-8296-5b9939c62221 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:34.721833 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b3568-a887-4412-8296-5b9939c62221 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:34.722068 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b3568-a887-4412-8296-5b9939c62221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:34.746969 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85d4b5-2e93-414e-a33e-8555771aa7e5 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:34.757988 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-e81b3568-a887-4412-8296-5b9939c62221 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:34.759201 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-e81b3568-a887-4412-8296-5b9939c62221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:34.769851 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:34.795131 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2778c430-9642-4e64-832e-a8ee078c6e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:34.796260 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778c430-9642-4e64-832e-a8ee078c6e2d None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:34.797138 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778c430-9642-4e64-832e-a8ee078c6e2d None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:34.797697 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778c430-9642-4e64-832e-a8ee078c6e2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:34.850307 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 170/342] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:34:34.851860 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ccab45-15c3-4372-9d54-9b1c04aaa06d None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:34.852159 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ccab45-15c3-4372-9d54-9b1c04aaa06d None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:34.852439 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ccab45-15c3-4372-9d54-9b1c04aaa06d None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:34.860696 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 171/343] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:34 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:34.861815 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ccab45-15c3-4372-9d54-9b1c04aaa06d None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:34.897365 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2778c430-9642-4e64-832e-a8ee078c6e2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:34.901376 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2778c430-9642-4e64-832e-a8ee078c6e2d None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:34.965182 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:35.006638 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ccab45-15c3-4372-9d54-9b1c04aaa06d None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:35.024444 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 173/344] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 13 23:34:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 23:34:35.025854 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf64d1-f2c2-47bb-b8a9-abef059549a5 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:35.026383 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf64d1-f2c2-47bb-b8a9-abef059549a5 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:35.026383 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf64d1-f2c2-47bb-b8a9-abef059549a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:35.045513 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-c5cf64d1-f2c2-47bb-b8a9-abef059549a5 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:35.046625 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-c5cf64d1-f2c2-47bb-b8a9-abef059549a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:35.053842 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b1ac4b-c252-4095-926f-7671e0a43c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:35.055428 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1ac4b-c252-4095-926f-7671e0a43c4e None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:35.055888 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1ac4b-c252-4095-926f-7671e0a43c4e None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:35.056348 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1ac4b-c252-4095-926f-7671e0a43c4e None admin] PATH_INFO: `/v3/roles/member` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:35.070188 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b1ac4b-c252-4095-926f-7671e0a43c4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:34:35.078163 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-83b1ac4b-c252-4095-926f-7671e0a43c4e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 23:34:35.078163 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:35.078163 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:35.078163 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:35.078163 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:35.078163 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:35.078163 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:35.078163 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:35.078163 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:35.078163 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:35.078163 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:35.078163 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:35.078163 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:34:35.078163 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:34:35.078163 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:34:35.078163 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:34:35.079050 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:34:35.079050 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:34:35.079050 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:34:35.079050 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:34:35.079050 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:35.079050 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:35.079050 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:35.079050 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:35.079050 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:35.079050 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:35.079050 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:35.079050 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:35.079050 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:35.079050 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:35.079050 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:35.079050 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:35.079840 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:35.079840 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:35.079840 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:35.079840 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:35.079840 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:34:35.079840 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:34:35.079840 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:34:35.079840 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:34:35.079840 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:34:35.079840 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:34:35.079840 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 23:34:35.079840 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:34:35.079840 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 172/345] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:34:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:35.080487 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b1ac4b-c252-4095-926f-7671e0a43c4e None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:35.083420 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:35.137406 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 174/346] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:34:35.139966 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71cf77c-b614-41d7-b71c-220557a1cee3 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:35.139966 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71cf77c-b614-41d7-b71c-220557a1cee3 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:35.139966 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71cf77c-b614-41d7-b71c-220557a1cee3 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:35.141693 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 175/347] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:35.142398 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71cf77c-b614-41d7-b71c-220557a1cee3 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:35.219569 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b1ac4b-c252-4095-926f-7671e0a43c4e None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:35.256118 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:35.265448 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb0c41-f6f8-4ff1-b062-42ca67c42f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:35.266255 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb0c41-f6f8-4ff1-b062-42ca67c42f1e None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:35.266540 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb0c41-f6f8-4ff1-b062-42ca67c42f1e None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:35.267217 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb0c41-f6f8-4ff1-b062-42ca67c42f1e None admin] PATH_INFO: `/v3/roles/member` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:35.279002 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb0c41-f6f8-4ff1-b062-42ca67c42f1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:34:35.283382 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71cf77c-b614-41d7-b71c-220557a1cee3 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:35.288859 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-cadb0c41-f6f8-4ff1-b062-42ca67c42f1e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 23:34:35.288859 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:35.288859 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:35.288859 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:35.288859 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:35.288859 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:35.288859 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:35.288859 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:35.288859 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:35.288859 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:35.288859 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:35.288859 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:35.288859 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:34:35.288859 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:34:35.288859 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:34:35.288859 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:34:35.289758 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:34:35.289758 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:34:35.289758 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:34:35.289758 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:34:35.289758 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:35.289758 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:35.289758 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:35.289758 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:35.289758 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:35.289758 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:35.289758 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:35.289758 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:35.289758 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:35.289758 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:35.289758 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:35.289758 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:35.290549 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:35.290549 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:35.290549 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:35.290549 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:35.290549 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:34:35.290549 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:34:35.290549 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:34:35.290549 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:34:35.290549 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:34:35.290549 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:34:35.290549 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 23:34:35.290549 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:34:35.290549 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 173/348] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:34:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:35.293323 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb0c41-f6f8-4ff1-b062-42ca67c42f1e None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:35.328665 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2999309-870e-4b72-ad58-c2674e44f9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:35.329499 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2999309-870e-4b72-ad58-c2674e44f9e8 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:35.329785 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2999309-870e-4b72-ad58-c2674e44f9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:35.330058 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2999309-870e-4b72-ad58-c2674e44f9e8 None admin] PATH_INFO: `/v3/projects/815dfc6ab25b4cac9e72ec762bd3d170` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:35.331365 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2999309-870e-4b72-ad58-c2674e44f9e8 None admin] RBAC: Authorizing `identity:get_project(project_id=815dfc6ab25b4cac9e72ec762bd3d170)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:35.332804 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2999309-870e-4b72-ad58-c2674e44f9e8 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:35.334522 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 176/349] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 13 23:34:35 2022] GET /identity/v3/projects/815dfc6ab25b4cac9e72ec762bd3d170 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:35.335829 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b57112-ee24-4901-9a14-737533de4efd None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:35.336118 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b57112-ee24-4901-9a14-737533de4efd None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:35.336392 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b57112-ee24-4901-9a14-737533de4efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:35.363500 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-22b57112-ee24-4901-9a14-737533de4efd None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:35.363500 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-22b57112-ee24-4901-9a14-737533de4efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:35.378708 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:35.431358 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb0c41-f6f8-4ff1-b062-42ca67c42f1e None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:35.460541 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 177/350] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:34:35.461347 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b57112-ee24-4901-9a14-737533de4efd None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:35.485672 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba56983-0890-464b-a112-a4b9663dcd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:35.485895 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba56983-0890-464b-a112-a4b9663dcd43 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:35.486127 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba56983-0890-464b-a112-a4b9663dcd43 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:35.486320 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba56983-0890-464b-a112-a4b9663dcd43 None admin] PATH_INFO: `/v3/roles` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:35.487066 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba56983-0890-464b-a112-a4b9663dcd43 None admin] RBAC: Adding query filter params (name=member) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:35.487469 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba56983-0890-464b-a112-a4b9663dcd43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:35.489187 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba56983-0890-464b-a112-a4b9663dcd43 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:35.499109 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 174/351] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 13 23:34:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:35.502065 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba56983-0890-464b-a112-a4b9663dcd43 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:35.558397 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:35.594940 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b57112-ee24-4901-9a14-737533de4efd None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:35.636946 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb7cd2-5c59-4f3b-a0bd-1516d964f68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:35.638281 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb7cd2-5c59-4f3b-a0bd-1516d964f68e None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:35.638727 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb7cd2-5c59-4f3b-a0bd-1516d964f68e None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:35.639003 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb7cd2-5c59-4f3b-a0bd-1516d964f68e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:35.655750 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccb7cd2-5c59-4f3b-a0bd-1516d964f68e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:34:35.664055 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba56983-0890-464b-a112-a4b9663dcd43 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:35.668738 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-1ccb7cd2-5c59-4f3b-a0bd-1516d964f68e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 23:34:35.668738 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:35.668738 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:35.668738 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:35.668738 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:35.668738 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:35.668738 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:35.668738 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:35.668738 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:35.668738 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:35.668738 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:35.668738 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:35.668738 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:34:35.668738 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:34:35.668738 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:34:35.668738 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:34:35.669931 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:34:35.669931 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:34:35.669931 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:34:35.669931 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:34:35.669931 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:35.669931 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:35.669931 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:35.669931 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:35.669931 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:35.669931 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:35.669931 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:35.669931 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:35.669931 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:35.669931 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:35.669931 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:35.669931 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:35.670977 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:35.670977 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:35.670977 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:35.670977 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:35.670977 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:34:35.670977 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:34:35.670977 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:34:35.670977 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:34:35.670977 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:34:35.670977 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:34:35.670977 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 23:34:35.670977 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:34:35.671965 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 178/352] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:34:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:35.673970 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb7cd2-5c59-4f3b-a0bd-1516d964f68e None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:35.699588 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:35.715056 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b11186-f841-4a06-b917-4d849e8cd028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:35.715824 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b11186-f841-4a06-b917-4d849e8cd028 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:35.716188 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b11186-f841-4a06-b917-4d849e8cd028 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:35.716532 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b11186-f841-4a06-b917-4d849e8cd028 None admin] PATH_INFO: `/v3/roles` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:35.717410 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b11186-f841-4a06-b917-4d849e8cd028 None admin] RBAC: Adding query filter params (name=member) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:35.718612 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b11186-f841-4a06-b917-4d849e8cd028 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:35.719264 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b11186-f841-4a06-b917-4d849e8cd028 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:35.736868 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 175/353] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 13 23:34:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:35.736868 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b11186-f841-4a06-b917-4d849e8cd028 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:35.817000 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb7cd2-5c59-4f3b-a0bd-1516d964f68e None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:35.861059 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b30b4-12e2-48da-9040-644c530a77e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:35.862114 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b30b4-12e2-48da-9040-644c530a77e5 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:35.862407 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b30b4-12e2-48da-9040-644c530a77e5 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:35.862838 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b30b4-12e2-48da-9040-644c530a77e5 None admin] PATH_INFO: `/v3/groups/d63fd75f31294f00ad6c2cddf396c567` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:35.866309 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b11186-f841-4a06-b917-4d849e8cd028 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:35.871076 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b30b4-12e2-48da-9040-644c530a77e5 None admin] RBAC: Authorizing `identity:get_group(group_id=d63fd75f31294f00ad6c2cddf396c567)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:35.872361 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b30b4-12e2-48da-9040-644c530a77e5 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:35.874473 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 179/354] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jul 13 23:34:35 2022] GET /identity/v3/groups/d63fd75f31294f00ad6c2cddf396c567 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:35.874937 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b30b4-12e2-48da-9040-644c530a77e5 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:35.878261 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:35.921454 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40607692-59f2-4ed8-b57a-1b36f9858a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:35.923305 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40607692-59f2-4ed8-b57a-1b36f9858a32 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:35.923611 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40607692-59f2-4ed8-b57a-1b36f9858a32 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:35.923897 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40607692-59f2-4ed8-b57a-1b36f9858a32 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:35.937087 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40607692-59f2-4ed8-b57a-1b36f9858a32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:34:35.945235 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-40607692-59f2-4ed8-b57a-1b36f9858a32 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 23:34:35.945235 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:35.945235 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:35.945235 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:35.945235 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:35.945235 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:35.945235 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:35.945235 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:35.945235 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:35.945235 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:35.945235 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:35.945235 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:35.945235 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:34:35.945235 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:34:35.945235 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:34:35.945235 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:34:35.946318 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:34:35.946318 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:34:35.946318 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:34:35.946318 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:34:35.946318 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:35.946318 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:35.946318 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:35.946318 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:35.946318 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:35.946318 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:35.946318 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:35.946318 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:35.946318 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:35.946318 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:35.946318 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:35.946318 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:35.947212 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:35.947212 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:35.947212 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:35.947212 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:35.947212 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:34:35.947212 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:34:35.947212 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:34:35.947212 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:34:35.947212 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:34:35.947212 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:34:35.947212 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 23:34:35.947212 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:34:35.947833 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 176/355] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jul 13 23:34:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:35.948176 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40607692-59f2-4ed8-b57a-1b36f9858a32 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:36.001014 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b30b4-12e2-48da-9040-644c530a77e5 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:36.018997 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:36.040262 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6795e560-93a2-4022-ab51-26613422c8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:36.040942 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795e560-93a2-4022-ab51-26613422c8e3 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:36.041227 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795e560-93a2-4022-ab51-26613422c8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:36.041503 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795e560-93a2-4022-ab51-26613422c8e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:36.087865 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40607692-59f2-4ed8-b57a-1b36f9858a32 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:36.129294 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6795e560-93a2-4022-ab51-26613422c8e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:36.130678 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6795e560-93a2-4022-ab51-26613422c8e3 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:36.132558 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:36.133523 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4bfcd-ef92-44dc-80c8-f809d7e84630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:36.134367 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4bfcd-ef92-44dc-80c8-f809d7e84630 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:36.134907 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4bfcd-ef92-44dc-80c8-f809d7e84630 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:36.136500 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4bfcd-ef92-44dc-80c8-f809d7e84630 None admin] PATH_INFO: `/v3/roles` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:36.137788 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd4bfcd-ef92-44dc-80c8-f809d7e84630 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:36.138133 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd4bfcd-ef92-44dc-80c8-f809d7e84630 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:36.139516 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd4bfcd-ef92-44dc-80c8-f809d7e84630 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:36.150187 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 177/356] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 13 23:34:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:36.150847 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4bfcd-ef92-44dc-80c8-f809d7e84630 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:36.250037 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 180/357] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 13 23:34:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 23:34:36.251489 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f39364-ddef-4591-bd16-e15dba8c70a1 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:36.251841 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f39364-ddef-4591-bd16-e15dba8c70a1 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:36.252289 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f39364-ddef-4591-bd16-e15dba8c70a1 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:36.253901 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 181/358] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:36.254630 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f39364-ddef-4591-bd16-e15dba8c70a1 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:36.280042 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4bfcd-ef92-44dc-80c8-f809d7e84630 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:36.289181 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:36.316884 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0678c07-5c45-43a1-b786-c67981a3fcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:36.317535 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0678c07-5c45-43a1-b786-c67981a3fcc2 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:36.317817 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0678c07-5c45-43a1-b786-c67981a3fcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:36.318092 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0678c07-5c45-43a1-b786-c67981a3fcc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:36.379074 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f39364-ddef-4591-bd16-e15dba8c70a1 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:36.380752 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:36.405092 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0678c07-5c45-43a1-b786-c67981a3fcc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:36.406941 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0678c07-5c45-43a1-b786-c67981a3fcc2 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:36.423441 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5ed62-a215-4a72-9936-9b1b4732daa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:36.424134 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5ed62-a215-4a72-9936-9b1b4732daa8 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:36.424421 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5ed62-a215-4a72-9936-9b1b4732daa8 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:36.424697 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5ed62-a215-4a72-9936-9b1b4732daa8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:36.425566 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead5ed62-a215-4a72-9936-9b1b4732daa8 None admin] RBAC: Adding query filter params (group.id=d63fd75f31294f00ad6c2cddf396c567, role.id=a27ce0a47b0a4f9bac8c6e78d9da4278, scope.project.id=815dfc6ab25b4cac9e72ec762bd3d170) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:36.425882 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead5ed62-a215-4a72-9936-9b1b4732daa8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:36.427319 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead5ed62-a215-4a72-9936-9b1b4732daa8 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:36.437368 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 182/359] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jul 13 23:34:36 2022] GET /identity/v3/role_assignments?group.id=d63fd75f31294f00ad6c2cddf396c567&scope.project.id=815dfc6ab25b4cac9e72ec762bd3d170&role.id=a27ce0a47b0a4f9bac8c6e78d9da4278 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:36.438765 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5ed62-a215-4a72-9936-9b1b4732daa8 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:36.566512 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 178/360] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 13 23:34:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 23:34:36.567652 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0678c07-5c45-43a1-b786-c67981a3fcc2 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:36.584226 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5ed62-a215-4a72-9936-9b1b4732daa8 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:36.585241 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:36.645513 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389feee3-382c-44ab-aec0-d3b922f9592e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:36.646202 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389feee3-382c-44ab-aec0-d3b922f9592e None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:36.646488 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389feee3-382c-44ab-aec0-d3b922f9592e None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:36.646766 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389feee3-382c-44ab-aec0-d3b922f9592e None admin] PATH_INFO: `/v3/roles` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:36.647519 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389feee3-382c-44ab-aec0-d3b922f9592e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:36.647830 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389feee3-382c-44ab-aec0-d3b922f9592e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:36.649250 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389feee3-382c-44ab-aec0-d3b922f9592e None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:36.659830 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 183/361] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 13 23:34:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:36.660755 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389feee3-382c-44ab-aec0-d3b922f9592e None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:36.704767 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:36.716704 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0678c07-5c45-43a1-b786-c67981a3fcc2 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:36.754241 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112eecb8-edb4-4dd7-b79e-2e3d1c3fd0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:36.755112 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112eecb8-edb4-4dd7-b79e-2e3d1c3fd0d8 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:36.755393 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112eecb8-edb4-4dd7-b79e-2e3d1c3fd0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:36.755664 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112eecb8-edb4-4dd7-b79e-2e3d1c3fd0d8 None admin] PATH_INFO: `/v3/users/683b9d9c3b7d4e619b345c38b1b902b9` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:36.756934 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112eecb8-edb4-4dd7-b79e-2e3d1c3fd0d8 None admin] RBAC: Authorizing `identity:get_user(user_id=683b9d9c3b7d4e619b345c38b1b902b9)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:36.758493 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112eecb8-edb4-4dd7-b79e-2e3d1c3fd0d8 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:36.766039 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 179/362] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 13 23:34:36 2022] GET /identity/v3/users/683b9d9c3b7d4e619b345c38b1b902b9 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:36.766039 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706dba7e-61e2-44ea-8f4e-77424de0f8b5 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:36.766039 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706dba7e-61e2-44ea-8f4e-77424de0f8b5 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:36.766039 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706dba7e-61e2-44ea-8f4e-77424de0f8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:36.782656 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-706dba7e-61e2-44ea-8f4e-77424de0f8b5 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:36.783948 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-706dba7e-61e2-44ea-8f4e-77424de0f8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:36.788998 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389feee3-382c-44ab-aec0-d3b922f9592e None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:36.825551 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec0ba79-81e5-4642-831f-5d052b802b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:36.826527 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0ba79-81e5-4642-831f-5d052b802b1e None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:36.826879 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0ba79-81e5-4642-831f-5d052b802b1e None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:36.827257 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0ba79-81e5-4642-831f-5d052b802b1e None admin] PATH_INFO: `/v3/projects/b360f1c130384ed8a57179e36d9b4f7d` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:36.828422 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec0ba79-81e5-4642-831f-5d052b802b1e None admin] RBAC: Authorizing `identity:get_project(project_id=b360f1c130384ed8a57179e36d9b4f7d)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:36.829917 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec0ba79-81e5-4642-831f-5d052b802b1e None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:36.836293 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 184/363] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 13 23:34:36 2022] GET /identity/v3/projects/b360f1c130384ed8a57179e36d9b4f7d => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:36.836293 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec0ba79-81e5-4642-831f-5d052b802b1e None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:36.868851 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 180/364] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:34:36.868851 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706dba7e-61e2-44ea-8f4e-77424de0f8b5 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:36.877049 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:36.957707 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:36.966207 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec0ba79-81e5-4642-831f-5d052b802b1e None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:36.989989 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706dba7e-61e2-44ea-8f4e-77424de0f8b5 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:37.001981 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838a98c-aa6d-4793-8d40-80d562b2976f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:37.002988 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838a98c-aa6d-4793-8d40-80d562b2976f None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:37.003368 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838a98c-aa6d-4793-8d40-80d562b2976f None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:37.003714 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838a98c-aa6d-4793-8d40-80d562b2976f None admin] PATH_INFO: `/v3/projects/815dfc6ab25b4cac9e72ec762bd3d170` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:37.005038 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838a98c-aa6d-4793-8d40-80d562b2976f None admin] RBAC: Authorizing `identity:get_project(project_id=815dfc6ab25b4cac9e72ec762bd3d170)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:37.006527 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838a98c-aa6d-4793-8d40-80d562b2976f None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:37.008377 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 185/365] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 13 23:34:36 2022] GET /identity/v3/projects/815dfc6ab25b4cac9e72ec762bd3d170 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:37.008989 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838a98c-aa6d-4793-8d40-80d562b2976f None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:37.034488 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2117f7d-6ae1-49cd-9f19-347e4c63cf70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:37.035800 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2117f7d-6ae1-49cd-9f19-347e4c63cf70 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:37.036089 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2117f7d-6ae1-49cd-9f19-347e4c63cf70 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:37.036369 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2117f7d-6ae1-49cd-9f19-347e4c63cf70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:37.109098 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2117f7d-6ae1-49cd-9f19-347e4c63cf70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:37.110569 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2117f7d-6ae1-49cd-9f19-347e4c63cf70 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:37.112185 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838a98c-aa6d-4793-8d40-80d562b2976f None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:37.119204 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:37.149276 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1bf42-d358-4487-92ef-4539f20fd4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:37.150198 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1bf42-d358-4487-92ef-4539f20fd4a0 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:37.150484 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1bf42-d358-4487-92ef-4539f20fd4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:37.150764 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1bf42-d358-4487-92ef-4539f20fd4a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:37.152165 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b1bf42-d358-4487-92ef-4539f20fd4a0 None admin] RBAC: Adding query filter params (role.id=ef94ce01ebc74f67b71913824c20fbe4, user.id=683b9d9c3b7d4e619b345c38b1b902b9, scope.system=all) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:37.152480 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b1bf42-d358-4487-92ef-4539f20fd4a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:37.153999 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b1bf42-d358-4487-92ef-4539f20fd4a0 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:37.168307 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 186/366] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Jul 13 23:34:37 2022] GET /identity/v3/role_assignments?user.id=683b9d9c3b7d4e619b345c38b1b902b9&scope.system=all&role.id=ef94ce01ebc74f67b71913824c20fbe4 => generated 510 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:37.177209 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1bf42-d358-4487-92ef-4539f20fd4a0 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:37.217342 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:37.232702 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 181/367] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 13 23:34:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 23:34:37.234063 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2117f7d-6ae1-49cd-9f19-347e4c63cf70 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:37.306899 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1bf42-d358-4487-92ef-4539f20fd4a0 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:37.346600 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36930f7-9a33-40f8-808d-d676f65e11b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:37.347474 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36930f7-9a33-40f8-808d-d676f65e11b2 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:37.347747 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36930f7-9a33-40f8-808d-d676f65e11b2 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:37.348044 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36930f7-9a33-40f8-808d-d676f65e11b2 None admin] PATH_INFO: `/v3/groups/d63fd75f31294f00ad6c2cddf396c567` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:37.349277 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36930f7-9a33-40f8-808d-d676f65e11b2 None admin] RBAC: Authorizing `identity:get_group(group_id=d63fd75f31294f00ad6c2cddf396c567)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:37.350736 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36930f7-9a33-40f8-808d-d676f65e11b2 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:37.352751 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 187/368] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jul 13 23:34:37 2022] GET /identity/v3/groups/d63fd75f31294f00ad6c2cddf396c567 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:37.353655 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36930f7-9a33-40f8-808d-d676f65e11b2 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:37.365942 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2117f7d-6ae1-49cd-9f19-347e4c63cf70 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:37.376263 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:37.413602 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94556657-dd4f-4140-b699-7104a29bbcc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:37.414402 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94556657-dd4f-4140-b699-7104a29bbcc3 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:37.414688 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94556657-dd4f-4140-b699-7104a29bbcc3 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:37.414969 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94556657-dd4f-4140-b699-7104a29bbcc3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:37.428670 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94556657-dd4f-4140-b699-7104a29bbcc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:34:37.436795 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-94556657-dd4f-4140-b699-7104a29bbcc3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 23:34:37.436795 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:37.436795 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:37.436795 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:37.436795 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:37.436795 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:37.436795 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:37.436795 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:37.436795 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:37.436795 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:37.436795 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:37.436795 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:37.436795 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:34:37.436795 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:34:37.436795 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:34:37.436795 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:34:37.437764 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:34:37.437764 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:34:37.437764 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:34:37.437764 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:34:37.437764 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:37.437764 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:37.437764 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:37.437764 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:37.437764 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:37.437764 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:37.437764 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:37.437764 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:37.437764 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:37.437764 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:37.437764 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:37.437764 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:37.438536 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:37.438536 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:37.438536 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:37.438536 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:37.438536 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:34:37.438536 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:34:37.438536 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:34:37.438536 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:34:37.438536 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:34:37.438536 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:34:37.438536 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 23:34:37.438536 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:34:37.439131 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 182/369] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 13 23:34:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:37.439955 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94556657-dd4f-4140-b699-7104a29bbcc3 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:37.485309 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:37.499009 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36930f7-9a33-40f8-808d-d676f65e11b2 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:37.556389 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf3d4c-f210-4325-b4a0-7ea91217d872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:37.556389 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf3d4c-f210-4325-b4a0-7ea91217d872 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:37.556389 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf3d4c-f210-4325-b4a0-7ea91217d872 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:37.556389 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf3d4c-f210-4325-b4a0-7ea91217d872 None admin] PATH_INFO: `/v3/groups/d63fd75f31294f00ad6c2cddf396c567` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:37.561001 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdf3d4c-f210-4325-b4a0-7ea91217d872 None admin] RBAC: Authorizing `identity:get_group(group_id=d63fd75f31294f00ad6c2cddf396c567)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:37.561001 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdf3d4c-f210-4325-b4a0-7ea91217d872 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:37.567076 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 188/370] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jul 13 23:34:37 2022] GET /identity/v3/groups/d63fd75f31294f00ad6c2cddf396c567 => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:37.568029 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf3d4c-f210-4325-b4a0-7ea91217d872 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:37.576028 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94556657-dd4f-4140-b699-7104a29bbcc3 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:37.625376 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f46ea4-a5dd-4703-9375-636e18ef7b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:37.626245 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f46ea4-a5dd-4703-9375-636e18ef7b12 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:37.626530 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f46ea4-a5dd-4703-9375-636e18ef7b12 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:37.626807 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f46ea4-a5dd-4703-9375-636e18ef7b12 None admin] PATH_INFO: `/v3/projects/b360f1c130384ed8a57179e36d9b4f7d` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:37.628528 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f46ea4-a5dd-4703-9375-636e18ef7b12 None admin] RBAC: Authorizing `identity:get_project(project_id=b360f1c130384ed8a57179e36d9b4f7d)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:37.631913 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f46ea4-a5dd-4703-9375-636e18ef7b12 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:37.633838 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 183/371] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 13 23:34:37 2022] GET /identity/v3/projects/b360f1c130384ed8a57179e36d9b4f7d => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:37.634608 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f46ea4-a5dd-4703-9375-636e18ef7b12 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:37.689152 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:37.721834 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf3d4c-f210-4325-b4a0-7ea91217d872 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:37.758917 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa545e-3c4e-437c-999a-722f1e1002f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:37.759781 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa545e-3c4e-437c-999a-722f1e1002f6 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:37.760226 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa545e-3c4e-437c-999a-722f1e1002f6 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:37.760643 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa545e-3c4e-437c-999a-722f1e1002f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:37.762234 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa545e-3c4e-437c-999a-722f1e1002f6 None admin] RBAC: Adding query filter params (group.id=d63fd75f31294f00ad6c2cddf396c567, role.id=69842edf01cf43eb814bb066f9652f48, scope.project.id=b360f1c130384ed8a57179e36d9b4f7d) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:37.762947 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa545e-3c4e-437c-999a-722f1e1002f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:37.764385 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa545e-3c4e-437c-999a-722f1e1002f6 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:37.769704 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f46ea4-a5dd-4703-9375-636e18ef7b12 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:37.781197 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 189/372] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jul 13 23:34:37 2022] GET /identity/v3/role_assignments?group.id=d63fd75f31294f00ad6c2cddf396c567&scope.project.id=b360f1c130384ed8a57179e36d9b4f7d&role.id=69842edf01cf43eb814bb066f9652f48 => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:37.782290 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa545e-3c4e-437c-999a-722f1e1002f6 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:37.810848 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539cd627-6335-4fec-88f0-50b310a4770f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:37.811625 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539cd627-6335-4fec-88f0-50b310a4770f None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:37.811825 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539cd627-6335-4fec-88f0-50b310a4770f None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:37.812274 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539cd627-6335-4fec-88f0-50b310a4770f None admin] PATH_INFO: `/v3/roles` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:37.813095 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539cd627-6335-4fec-88f0-50b310a4770f None admin] RBAC: Adding query filter params (name=admin) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:37.813403 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539cd627-6335-4fec-88f0-50b310a4770f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:37.814814 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539cd627-6335-4fec-88f0-50b310a4770f None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:37.823926 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:37.824278 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 184/373] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:34:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:37.824982 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539cd627-6335-4fec-88f0-50b310a4770f None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:37.950258 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:37.951426 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa545e-3c4e-437c-999a-722f1e1002f6 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:37.957169 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539cd627-6335-4fec-88f0-50b310a4770f None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:37.993382 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8925f699-7328-4e9f-8df4-6ae26e4c36d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:37.994553 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925f699-7328-4e9f-8df4-6ae26e4c36d3 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:37.994903 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925f699-7328-4e9f-8df4-6ae26e4c36d3 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:37.995781 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925f699-7328-4e9f-8df4-6ae26e4c36d3 None admin] PATH_INFO: `/v3/groups/d63fd75f31294f00ad6c2cddf396c567` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:37.997084 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8925f699-7328-4e9f-8df4-6ae26e4c36d3 None admin] RBAC: Authorizing `identity:get_group(group_id=d63fd75f31294f00ad6c2cddf396c567)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:37.998878 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8925f699-7328-4e9f-8df4-6ae26e4c36d3 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:38.000649 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 185/374] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jul 13 23:34:37 2022] GET /identity/v3/groups/d63fd75f31294f00ad6c2cddf396c567 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:38.004773 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2047b56-f74f-4576-924f-463882c67bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:38.005744 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2047b56-f74f-4576-924f-463882c67bc7 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:38.006224 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2047b56-f74f-4576-924f-463882c67bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:38.006325 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8925f699-7328-4e9f-8df4-6ae26e4c36d3 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:38.006761 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2047b56-f74f-4576-924f-463882c67bc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:38.007858 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2047b56-f74f-4576-924f-463882c67bc7 None admin] RBAC: Adding query filter params (group.id=d63fd75f31294f00ad6c2cddf396c567, role.id=69842edf01cf43eb814bb066f9652f48, scope.project.id=815dfc6ab25b4cac9e72ec762bd3d170) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:38.008387 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2047b56-f74f-4576-924f-463882c67bc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:38.012218 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2047b56-f74f-4576-924f-463882c67bc7 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:38.019175 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 190/375] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jul 13 23:34:37 2022] GET /identity/v3/role_assignments?group.id=d63fd75f31294f00ad6c2cddf396c567&scope.project.id=815dfc6ab25b4cac9e72ec762bd3d170&role.id=69842edf01cf43eb814bb066f9652f48 => generated 260 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:38.021637 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2047b56-f74f-4576-924f-463882c67bc7 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:38.148525 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8925f699-7328-4e9f-8df4-6ae26e4c36d3 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:38.193591 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a1cbd-381c-456d-8edf-4024e3bcc4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:38.194250 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a1cbd-381c-456d-8edf-4024e3bcc4ae None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:38.194532 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a1cbd-381c-456d-8edf-4024e3bcc4ae None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:38.194805 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a1cbd-381c-456d-8edf-4024e3bcc4ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:38.256704 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:38.264307 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:38.287231 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2047b56-f74f-4576-924f-463882c67bc7 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:38.314758 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a1cbd-381c-456d-8edf-4024e3bcc4ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:38.316223 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a1cbd-381c-456d-8edf-4024e3bcc4ae None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:38.343100 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468bf23-f9fd-4f80-9bac-4536348b45d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:38.343760 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468bf23-f9fd-4f80-9bac-4536348b45d4 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:38.344050 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468bf23-f9fd-4f80-9bac-4536348b45d4 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:38.344325 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468bf23-f9fd-4f80-9bac-4536348b45d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:38.345339 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1468bf23-f9fd-4f80-9bac-4536348b45d4 None admin] RBAC: Adding query filter params (group.id=d63fd75f31294f00ad6c2cddf396c567, role.id=a27ce0a47b0a4f9bac8c6e78d9da4278, scope.project.id=b360f1c130384ed8a57179e36d9b4f7d) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:38.345546 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1468bf23-f9fd-4f80-9bac-4536348b45d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:38.346972 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1468bf23-f9fd-4f80-9bac-4536348b45d4 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:38.361658 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 191/376] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jul 13 23:34:38 2022] GET /identity/v3/role_assignments?group.id=d63fd75f31294f00ad6c2cddf396c567&scope.project.id=b360f1c130384ed8a57179e36d9b4f7d&role.id=a27ce0a47b0a4f9bac8c6e78d9da4278 => generated 260 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:38.442998 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 186/377] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 13 23:34:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 23:34:38.454011 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468bf23-f9fd-4f80-9bac-4536348b45d4 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:38.609761 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468bf23-f9fd-4f80-9bac-4536348b45d4 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:38.650535 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da9c54-208a-4089-984d-97c32dbec09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:38.652035 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da9c54-208a-4089-984d-97c32dbec09c None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:38.652320 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da9c54-208a-4089-984d-97c32dbec09c None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:38.652595 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da9c54-208a-4089-984d-97c32dbec09c None admin] PATH_INFO: `/v3/projects/f6c258143da34685aa94a405e9ab3d07` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:38.653810 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da9c54-208a-4089-984d-97c32dbec09c None admin] RBAC: Authorizing `identity:get_project(project_id=f6c258143da34685aa94a405e9ab3d07)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:38.655262 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da9c54-208a-4089-984d-97c32dbec09c None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:38.658348 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 192/378] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 13 23:34:38 2022] GET /identity/v3/projects/f6c258143da34685aa94a405e9ab3d07 => generated 344 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:38.663027 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a1cbd-381c-456d-8edf-4024e3bcc4ae None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:38.793877 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:38.846655 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a1cbd-381c-456d-8edf-4024e3bcc4ae None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:38.848624 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e832f90-6f88-46c1-81a3-ea37d6d11879 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:38.848939 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e832f90-6f88-46c1-81a3-ea37d6d11879 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:38.849219 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e832f90-6f88-46c1-81a3-ea37d6d11879 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:38.852001 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 193/379] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:38.856856 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ce3fe-7fd6-420c-9f99-1b1044a75bac None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:38.857149 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ce3fe-7fd6-420c-9f99-1b1044a75bac None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:38.857427 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ce3fe-7fd6-420c-9f99-1b1044a75bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:38.885664 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-3f6ce3fe-7fd6-420c-9f99-1b1044a75bac None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:38.887160 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-3f6ce3fe-7fd6-420c-9f99-1b1044a75bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:38.909432 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa612a-a89a-4205-9b14-5d0f688787f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:38.910296 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa612a-a89a-4205-9b14-5d0f688787f6 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:38.910577 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa612a-a89a-4205-9b14-5d0f688787f6 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:38.910851 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa612a-a89a-4205-9b14-5d0f688787f6 None admin] PATH_INFO: `/v3/groups/4f5553eeba784c3fba520d524186a50f` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:38.917571 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:38.924689 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aa612a-a89a-4205-9b14-5d0f688787f6 None admin] RBAC: Authorizing `identity:get_group(group_id=4f5553eeba784c3fba520d524186a50f)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:38.924689 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aa612a-a89a-4205-9b14-5d0f688787f6 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:38.925206 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 187/380] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jul 13 23:34:38 2022] GET /identity/v3/groups/4f5553eeba784c3fba520d524186a50f => generated 229 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:38.933597 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa612a-a89a-4205-9b14-5d0f688787f6 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:38.997494 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 194/381] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 23:34:39.041380 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ce3fe-7fd6-420c-9f99-1b1044a75bac None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:39.134852 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa612a-a89a-4205-9b14-5d0f688787f6 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:39.155649 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ce3fe-7fd6-420c-9f99-1b1044a75bac None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:39.201623 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac41b67-b3ac-49e0-ab5b-81251bf12a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:39.202448 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac41b67-b3ac-49e0-ab5b-81251bf12a9e None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:39.202733 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac41b67-b3ac-49e0-ab5b-81251bf12a9e None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:39.203006 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac41b67-b3ac-49e0-ab5b-81251bf12a9e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:39.204604 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:39.221660 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76a440-734f-47f8-96d6-cadaf4f6784c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:39.222323 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76a440-734f-47f8-96d6-cadaf4f6784c None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:39.222610 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76a440-734f-47f8-96d6-cadaf4f6784c None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:39.223120 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76a440-734f-47f8-96d6-cadaf4f6784c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:39.226169 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76a440-734f-47f8-96d6-cadaf4f6784c None admin] RBAC: Adding query filter params (group.id=4f5553eeba784c3fba520d524186a50f, role.id=46deff0e06964626a5600c9641454603, scope.project.id=f6c258143da34685aa94a405e9ab3d07) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:39.226491 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76a440-734f-47f8-96d6-cadaf4f6784c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:39.227934 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76a440-734f-47f8-96d6-cadaf4f6784c None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:39.234285 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac41b67-b3ac-49e0-ab5b-81251bf12a9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:34:39.234875 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 188/382] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jul 13 23:34:38 2022] GET /identity/v3/role_assignments?group.id=4f5553eeba784c3fba520d524186a50f&scope.project.id=f6c258143da34685aa94a405e9ab3d07&role.id=46deff0e06964626a5600c9641454603 => generated 260 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:34:39.242827 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-8ac41b67-b3ac-49e0-ab5b-81251bf12a9e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 23:34:39.242827 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:39.242827 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:39.242827 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:39.242827 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:39.242827 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:39.242827 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:39.242827 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:39.242827 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:39.242827 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:39.242827 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:39.242827 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:39.242827 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:34:39.242827 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:34:39.242827 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:34:39.242827 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:34:39.243779 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:34:39.243779 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:34:39.243779 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:34:39.243779 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:34:39.243779 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:39.243779 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:39.243779 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:39.243779 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:39.243779 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:39.243779 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:39.243779 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:39.243779 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:39.243779 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:39.243779 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:39.243779 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:39.243779 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:39.244559 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:39.244559 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:39.244559 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:39.244559 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:39.244559 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:34:39.244559 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:34:39.244559 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:34:39.244559 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:34:39.244559 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:34:39.244559 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:34:39.244559 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 23:34:39.244559 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:34:39.253835 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 195/383] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jul 13 23:34:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 23:34:39.262136 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76a440-734f-47f8-96d6-cadaf4f6784c None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:39.402975 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76a440-734f-47f8-96d6-cadaf4f6784c None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:39.440715 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece40769-94d3-44e0-ada1-dd364e1c2003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:39.441424 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece40769-94d3-44e0-ada1-dd364e1c2003 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:39.441709 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece40769-94d3-44e0-ada1-dd364e1c2003 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:39.441988 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece40769-94d3-44e0-ada1-dd364e1c2003 None admin] PATH_INFO: `/v3/roles` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:39.442731 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece40769-94d3-44e0-ada1-dd364e1c2003 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:39.443040 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece40769-94d3-44e0-ada1-dd364e1c2003 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:39.444428 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece40769-94d3-44e0-ada1-dd364e1c2003 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:39.454424 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 189/384] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 13 23:34:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:39.462246 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac41b67-b3ac-49e0-ab5b-81251bf12a9e None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:39.481054 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:39.602230 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac41b67-b3ac-49e0-ab5b-81251bf12a9e None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:39.659937 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4af562-a5e5-4b3a-82a4-5e1346939eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:39.661165 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4af562-a5e5-4b3a-82a4-5e1346939eb1 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:39.661651 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4af562-a5e5-4b3a-82a4-5e1346939eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:39.662118 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4af562-a5e5-4b3a-82a4-5e1346939eb1 None admin] PATH_INFO: `/v3/groups/d63fd75f31294f00ad6c2cddf396c567` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:39.665553 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4af562-a5e5-4b3a-82a4-5e1346939eb1 None admin] RBAC: Authorizing `identity:get_group(group_id=d63fd75f31294f00ad6c2cddf396c567)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:39.667826 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4af562-a5e5-4b3a-82a4-5e1346939eb1 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:39.669659 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 196/385] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jul 13 23:34:39 2022] GET /identity/v3/groups/d63fd75f31294f00ad6c2cddf396c567 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:39.675159 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece40769-94d3-44e0-ada1-dd364e1c2003 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:39.751011 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:39.812420 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece40769-94d3-44e0-ada1-dd364e1c2003 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:39.852438 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf6e8c-1981-4096-bcc5-6b2ad7cd8fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:39.853334 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf6e8c-1981-4096-bcc5-6b2ad7cd8fcd None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:39.853618 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf6e8c-1981-4096-bcc5-6b2ad7cd8fcd None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:39.853893 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf6e8c-1981-4096-bcc5-6b2ad7cd8fcd None admin] PATH_INFO: `/v3/projects/815dfc6ab25b4cac9e72ec762bd3d170` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:39.855831 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf6e8c-1981-4096-bcc5-6b2ad7cd8fcd None admin] RBAC: Authorizing `identity:get_project(project_id=815dfc6ab25b4cac9e72ec762bd3d170)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:39.857394 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf6e8c-1981-4096-bcc5-6b2ad7cd8fcd None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:39.859413 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 190/386] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 13 23:34:39 2022] GET /identity/v3/projects/815dfc6ab25b4cac9e72ec762bd3d170 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:39.866081 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4af562-a5e5-4b3a-82a4-5e1346939eb1 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:40.001268 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:40.032636 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4af562-a5e5-4b3a-82a4-5e1346939eb1 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:40.080406 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ed93b-f516-4c97-ae15-8e90d36a1c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:40.081324 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ed93b-f516-4c97-ae15-8e90d36a1c42 None admin] REQUEST_METHOD: `PUT` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:40.081610 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ed93b-f516-4c97-ae15-8e90d36a1c42 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:40.081888 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ed93b-f516-4c97-ae15-8e90d36a1c42 None admin] PATH_INFO: `/v3/projects/815dfc6ab25b4cac9e72ec762bd3d170/groups/d63fd75f31294f00ad6c2cddf396c567/roles/a27ce0a47b0a4f9bac8c6e78d9da4278` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:40.090500 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ed93b-f516-4c97-ae15-8e90d36a1c42 None admin] RBAC: Authorizing `identity:create_grant(project_id=815dfc6ab25b4cac9e72ec762bd3d170, group_id=d63fd75f31294f00ad6c2cddf396c567, role_id=a27ce0a47b0a4f9bac8c6e78d9da4278)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:40.092010 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ed93b-f516-4c97-ae15-8e90d36a1c42 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:40.112933 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 197/387] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Jul 13 23:34:39 2022] PUT /identity/v3/projects/815dfc6ab25b4cac9e72ec762bd3d170/groups/d63fd75f31294f00ad6c2cddf396c567/roles/a27ce0a47b0a4f9bac8c6e78d9da4278 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 23:34:40.531232 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59e54f-8928-408b-986f-02b57bcdec25 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:40.531759 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59e54f-8928-408b-986f-02b57bcdec25 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:40.531759 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59e54f-8928-408b-986f-02b57bcdec25 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:40.533437 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 191/388] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:40.544169 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886d5f0-2a6a-4102-8071-cb4d3bf1cbb2 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:40.544571 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886d5f0-2a6a-4102-8071-cb4d3bf1cbb2 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:40.544748 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886d5f0-2a6a-4102-8071-cb4d3bf1cbb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:40.562427 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-7886d5f0-2a6a-4102-8071-cb4d3bf1cbb2 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:40.563628 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-7886d5f0-2a6a-4102-8071-cb4d3bf1cbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:40.636590 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 198/389] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:34:40.638531 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad53182-e0d0-4716-aaa5-65386b171e05 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:40.638821 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad53182-e0d0-4716-aaa5-65386b171e05 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:40.639101 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad53182-e0d0-4716-aaa5-65386b171e05 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:40.640717 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 192/390] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:40.646009 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3e5bc-296d-42c0-9cd5-298cea0a3ab1 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:40.646300 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3e5bc-296d-42c0-9cd5-298cea0a3ab1 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:40.646582 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3e5bc-296d-42c0-9cd5-298cea0a3ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:40.669877 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-45d3e5bc-296d-42c0-9cd5-298cea0a3ab1 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:40.671066 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-45d3e5bc-296d-42c0-9cd5-298cea0a3ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:40.711040 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad53182-e0d0-4716-aaa5-65386b171e05 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:40.761560 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:40.775805 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 199/391] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:34:40.811221 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d3e5bc-296d-42c0-9cd5-298cea0a3ab1 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:40.886629 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad53182-e0d0-4716-aaa5-65386b171e05 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:40.912432 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:40.943238 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02458d-640e-43d9-8a46-d269edb6b0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:40.944052 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02458d-640e-43d9-8a46-d269edb6b0a3 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:40.944343 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02458d-640e-43d9-8a46-d269edb6b0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:40.944608 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02458d-640e-43d9-8a46-d269edb6b0a3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:40.966598 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a02458d-640e-43d9-8a46-d269edb6b0a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:34:40.980202 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-0a02458d-640e-43d9-8a46-d269edb6b0a3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 23:34:40.980202 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:40.980202 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:40.980202 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:40.980202 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:40.980202 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:40.980202 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:40.980202 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:40.980202 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:40.980202 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:40.980202 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:40.980202 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:40.980202 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:34:40.980202 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:34:40.980202 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:34:40.980202 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:34:40.981336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:34:40.981336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:34:40.981336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:34:40.981336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:34:40.981336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:40.981336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:40.981336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:40.981336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:40.981336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:40.981336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:40.981336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:40.981336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:40.981336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:40.981336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:40.981336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:40.981336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:40.982140 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:40.982140 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:40.982140 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:40.982140 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:40.982140 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:34:40.982140 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:34:40.982140 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:34:40.982140 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:34:40.982140 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:34:40.982140 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:34:40.982140 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 23:34:40.982140 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:34:40.984203 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 193/392] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:34:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:40.987936 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02458d-640e-43d9-8a46-d269edb6b0a3 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:41.008376 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d3e5bc-296d-42c0-9cd5-298cea0a3ab1 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:41.084554 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d05d5-0ef7-4653-8b65-c898af67fc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:41.085309 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d05d5-0ef7-4653-8b65-c898af67fc0a None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:41.085596 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d05d5-0ef7-4653-8b65-c898af67fc0a None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:41.085877 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d05d5-0ef7-4653-8b65-c898af67fc0a None admin] PATH_INFO: `/v3/roles/member` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:41.113727 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d05d5-0ef7-4653-8b65-c898af67fc0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:34:41.129035 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-463d05d5-0ef7-4653-8b65-c898af67fc0a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 23:34:41.129035 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:41.129035 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:41.129035 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:41.129035 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:41.129035 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:41.129035 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:41.129035 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:41.129035 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:41.129035 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:41.129035 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:41.129035 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:41.129035 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:34:41.129035 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:34:41.129035 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:34:41.129035 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:34:41.129901 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:34:41.129901 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:34:41.129901 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:34:41.129901 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:34:41.129901 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:41.129901 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:41.129901 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:41.129901 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:41.129901 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:41.129901 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:41.129901 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:41.129901 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:41.129901 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:41.129901 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:41.129901 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:41.129901 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:41.130662 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:41.130662 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:41.130662 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:41.130662 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:41.130662 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:34:41.130662 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:34:41.130662 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:34:41.130662 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:34:41.130662 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:34:41.130662 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:34:41.130662 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 23:34:41.130662 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:34:41.133359 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 200/393] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:34:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 23:34:41.140057 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d05d5-0ef7-4653-8b65-c898af67fc0a None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:41.142691 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02458d-640e-43d9-8a46-d269edb6b0a3 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:41.196695 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4124db-a67b-47d3-af26-cc2a381981e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:41.197395 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4124db-a67b-47d3-af26-cc2a381981e7 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:41.197682 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4124db-a67b-47d3-af26-cc2a381981e7 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:41.197962 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4124db-a67b-47d3-af26-cc2a381981e7 None admin] PATH_INFO: `/v3/roles` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:41.199267 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4124db-a67b-47d3-af26-cc2a381981e7 None admin] RBAC: Adding query filter params (name=member) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:41.199580 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4124db-a67b-47d3-af26-cc2a381981e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:41.201029 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4124db-a67b-47d3-af26-cc2a381981e7 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:41.210062 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 194/394] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 13 23:34:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:41.211315 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dec566-4856-4f03-b2fe-b1ad963a6efd None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:41.211605 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dec566-4856-4f03-b2fe-b1ad963a6efd None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:41.211883 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dec566-4856-4f03-b2fe-b1ad963a6efd None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:41.217251 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:41.218840 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 195/395] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:41.219591 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dec566-4856-4f03-b2fe-b1ad963a6efd None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:41.267506 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d05d5-0ef7-4653-8b65-c898af67fc0a None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:41.271200 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:41.304457 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce2e15-82db-49d2-a4ad-6d717d18a6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:41.305229 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce2e15-82db-49d2-a4ad-6d717d18a6b2 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:41.305519 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce2e15-82db-49d2-a4ad-6d717d18a6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:41.305801 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce2e15-82db-49d2-a4ad-6d717d18a6b2 None admin] PATH_INFO: `/v3/roles` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:41.306552 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce2e15-82db-49d2-a4ad-6d717d18a6b2 None admin] RBAC: Adding query filter params (name=member) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:41.306896 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce2e15-82db-49d2-a4ad-6d717d18a6b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:41.309181 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce2e15-82db-49d2-a4ad-6d717d18a6b2 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:41.318697 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 201/396] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 13 23:34:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:41.320107 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0c5f6-5b3b-461c-9837-a5e963e461d2 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:41.320403 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0c5f6-5b3b-461c-9837-a5e963e461d2 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:41.320687 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0c5f6-5b3b-461c-9837-a5e963e461d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:41.334741 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dec566-4856-4f03-b2fe-b1ad963a6efd None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:41.340523 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-bfa0c5f6-5b3b-461c-9837-a5e963e461d2 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:41.341845 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-bfa0c5f6-5b3b-461c-9837-a5e963e461d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:41.372088 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b6346-282d-4522-987a-f4091760f92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:41.373295 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b6346-282d-4522-987a-f4091760f92a None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:41.373809 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b6346-282d-4522-987a-f4091760f92a None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:41.374480 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b6346-282d-4522-987a-f4091760f92a None admin] PATH_INFO: `/v3/groups/d63fd75f31294f00ad6c2cddf396c567` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:41.375963 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2b6346-282d-4522-987a-f4091760f92a None admin] RBAC: Authorizing `identity:get_group(group_id=d63fd75f31294f00ad6c2cddf396c567)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:41.378024 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2b6346-282d-4522-987a-f4091760f92a None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:41.384476 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 196/397] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jul 13 23:34:41 2022] GET /identity/v3/groups/d63fd75f31294f00ad6c2cddf396c567 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:41.385562 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b6346-282d-4522-987a-f4091760f92a None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:41.420921 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 202/398] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:34:41.422092 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0c5f6-5b3b-461c-9837-a5e963e461d2 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:41.493636 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:41.535013 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b6346-282d-4522-987a-f4091760f92a None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:41.551653 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:41.566402 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0c5f6-5b3b-461c-9837-a5e963e461d2 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:41.575937 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69afeb-1e79-4701-bc41-11e4d40673c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:41.577088 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69afeb-1e79-4701-bc41-11e4d40673c0 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:41.577594 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69afeb-1e79-4701-bc41-11e4d40673c0 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:41.578066 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69afeb-1e79-4701-bc41-11e4d40673c0 None admin] PATH_INFO: `/v3/groups/d63fd75f31294f00ad6c2cddf396c567` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:41.579472 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69afeb-1e79-4701-bc41-11e4d40673c0 None admin] RBAC: Authorizing `identity:get_group(group_id=d63fd75f31294f00ad6c2cddf396c567)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:41.581151 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69afeb-1e79-4701-bc41-11e4d40673c0 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:41.583289 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 197/399] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jul 13 23:34:41 2022] GET /identity/v3/groups/d63fd75f31294f00ad6c2cddf396c567 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:41.584345 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69afeb-1e79-4701-bc41-11e4d40673c0 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:41.610307 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83667ea-0d52-49b2-bdf0-7874ea16c8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:41.611375 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83667ea-0d52-49b2-bdf0-7874ea16c8ba None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:41.611668 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83667ea-0d52-49b2-bdf0-7874ea16c8ba None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:41.612071 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83667ea-0d52-49b2-bdf0-7874ea16c8ba None admin] PATH_INFO: `/v3/projects/815dfc6ab25b4cac9e72ec762bd3d170` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:41.613488 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83667ea-0d52-49b2-bdf0-7874ea16c8ba None admin] RBAC: Authorizing `identity:get_project(project_id=815dfc6ab25b4cac9e72ec762bd3d170)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:41.615554 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83667ea-0d52-49b2-bdf0-7874ea16c8ba None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:41.622536 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 203/400] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 13 23:34:41 2022] GET /identity/v3/projects/815dfc6ab25b4cac9e72ec762bd3d170 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:41.622536 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83667ea-0d52-49b2-bdf0-7874ea16c8ba None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:41.705046 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69afeb-1e79-4701-bc41-11e4d40673c0 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:41.745951 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2165f2-c6b3-45b3-b31e-d8c40dbb4ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:41.747339 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2165f2-c6b3-45b3-b31e-d8c40dbb4ea5 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:41.748005 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2165f2-c6b3-45b3-b31e-d8c40dbb4ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:41.748815 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2165f2-c6b3-45b3-b31e-d8c40dbb4ea5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:41.754803 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83667ea-0d52-49b2-bdf0-7874ea16c8ba None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:41.764280 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2165f2-c6b3-45b3-b31e-d8c40dbb4ea5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:34:41.775414 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-6f2165f2-c6b3-45b3-b31e-d8c40dbb4ea5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 23:34:41.775414 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:41.775414 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:41.775414 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:41.775414 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:41.775414 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:41.775414 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:41.775414 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:41.775414 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:41.775414 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:41.775414 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:41.775414 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:41.775414 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:34:41.775414 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:34:41.775414 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:34:41.775414 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:34:41.777259 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:34:41.777259 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:34:41.777259 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:34:41.777259 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:34:41.777259 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:41.777259 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:41.777259 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:41.777259 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:41.777259 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:41.777259 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:41.777259 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:41.777259 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:41.777259 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:41.777259 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:41.777259 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:41.777259 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:41.778304 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:41.778304 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:41.778304 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:41.778304 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:41.778304 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:34:41.778304 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:34:41.778304 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:34:41.778304 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:34:41.778304 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:34:41.778304 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:34:41.778304 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 23:34:41.778304 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:34:41.778895 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:41.785978 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 198/401] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jul 13 23:34:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:41.785978 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2165f2-c6b3-45b3-b31e-d8c40dbb4ea5 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:41.804394 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c8c92-b3eb-4441-bcad-4ef7ee9e78ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:41.805629 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c8c92-b3eb-4441-bcad-4ef7ee9e78ac None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:41.805918 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c8c92-b3eb-4441-bcad-4ef7ee9e78ac None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:41.806195 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c8c92-b3eb-4441-bcad-4ef7ee9e78ac None admin] PATH_INFO: `/v3/projects/b360f1c130384ed8a57179e36d9b4f7d` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:41.809504 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486c8c92-b3eb-4441-bcad-4ef7ee9e78ac None admin] RBAC: Authorizing `identity:get_project(project_id=b360f1c130384ed8a57179e36d9b4f7d)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:41.811319 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486c8c92-b3eb-4441-bcad-4ef7ee9e78ac None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:41.815237 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 204/402] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 13 23:34:41 2022] GET /identity/v3/projects/b360f1c130384ed8a57179e36d9b4f7d => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:41.816104 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c8c92-b3eb-4441-bcad-4ef7ee9e78ac None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:41.846501 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:41.921901 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2165f2-c6b3-45b3-b31e-d8c40dbb4ea5 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:41.963529 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9fde94-efee-4465-a182-7b143ea37fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:41.965493 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fde94-efee-4465-a182-7b143ea37fe5 None admin] REQUEST_METHOD: `PUT` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:41.965981 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fde94-efee-4465-a182-7b143ea37fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:41.966474 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fde94-efee-4465-a182-7b143ea37fe5 None admin] PATH_INFO: `/v3/projects/815dfc6ab25b4cac9e72ec762bd3d170/groups/d63fd75f31294f00ad6c2cddf396c567/roles/69842edf01cf43eb814bb066f9652f48` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:41.968735 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9fde94-efee-4465-a182-7b143ea37fe5 None admin] RBAC: Authorizing `identity:create_grant(project_id=815dfc6ab25b4cac9e72ec762bd3d170, group_id=d63fd75f31294f00ad6c2cddf396c567, role_id=69842edf01cf43eb814bb066f9652f48)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:41.970457 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9fde94-efee-4465-a182-7b143ea37fe5 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:41.970650 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c8c92-b3eb-4441-bcad-4ef7ee9e78ac None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:41.992945 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 199/403] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Jul 13 23:34:41 2022] PUT /identity/v3/projects/815dfc6ab25b4cac9e72ec762bd3d170/groups/d63fd75f31294f00ad6c2cddf396c567/roles/69842edf01cf43eb814bb066f9652f48 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 23:34:41.994347 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9fde94-efee-4465-a182-7b143ea37fe5 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:42.012090 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa6a47-a603-44c7-a40f-227c093d3889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:42.013734 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa6a47-a603-44c7-a40f-227c093d3889 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:42.013734 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa6a47-a603-44c7-a40f-227c093d3889 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:42.014034 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa6a47-a603-44c7-a40f-227c093d3889 None admin] PATH_INFO: `/v3/roles` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:42.014981 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaa6a47-a603-44c7-a40f-227c093d3889 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:42.015298 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaa6a47-a603-44c7-a40f-227c093d3889 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:42.016931 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaa6a47-a603-44c7-a40f-227c093d3889 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:42.033042 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 205/404] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 13 23:34:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:42.046065 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa6a47-a603-44c7-a40f-227c093d3889 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:42.116995 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:42.134474 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:42.138819 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9fde94-efee-4465-a182-7b143ea37fe5 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:42.180500 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc8223-400e-430f-8c79-3f667fe1c8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:42.181755 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc8223-400e-430f-8c79-3f667fe1c8da None admin] REQUEST_METHOD: `PUT` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:42.182221 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc8223-400e-430f-8c79-3f667fe1c8da None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:42.182669 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc8223-400e-430f-8c79-3f667fe1c8da None admin] PATH_INFO: `/v3/projects/b360f1c130384ed8a57179e36d9b4f7d/groups/d63fd75f31294f00ad6c2cddf396c567/roles/69842edf01cf43eb814bb066f9652f48` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:42.185264 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc8223-400e-430f-8c79-3f667fe1c8da None admin] RBAC: Authorizing `identity:create_grant(project_id=b360f1c130384ed8a57179e36d9b4f7d, group_id=d63fd75f31294f00ad6c2cddf396c567, role_id=69842edf01cf43eb814bb066f9652f48)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:42.187032 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc8223-400e-430f-8c79-3f667fe1c8da None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:42.203463 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa6a47-a603-44c7-a40f-227c093d3889 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:42.206435 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 200/405] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Jul 13 23:34:41 2022] PUT /identity/v3/projects/b360f1c130384ed8a57179e36d9b4f7d/groups/d63fd75f31294f00ad6c2cddf396c567/roles/69842edf01cf43eb814bb066f9652f48 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 23:34:42.208147 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b970f70-c8c4-4fcc-8b82-93edda0d5acc None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:42.208642 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b970f70-c8c4-4fcc-8b82-93edda0d5acc None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:42.209118 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b970f70-c8c4-4fcc-8b82-93edda0d5acc None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:42.211133 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 201/406] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:42.218926 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42799f6-f1ea-4f43-b6b4-68241e2ba3f4 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:42.218926 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42799f6-f1ea-4f43-b6b4-68241e2ba3f4 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:42.218926 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42799f6-f1ea-4f43-b6b4-68241e2ba3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:42.245801 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ffa6e-6572-43dc-9399-cb84e7790718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:42.246686 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ffa6e-6572-43dc-9399-cb84e7790718 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:42.246970 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ffa6e-6572-43dc-9399-cb84e7790718 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:42.247245 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ffa6e-6572-43dc-9399-cb84e7790718 None admin] PATH_INFO: `/v3/groups/d63fd75f31294f00ad6c2cddf396c567` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:42.248504 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19ffa6e-6572-43dc-9399-cb84e7790718 None admin] RBAC: Authorizing `identity:get_group(group_id=d63fd75f31294f00ad6c2cddf396c567)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:42.250005 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19ffa6e-6572-43dc-9399-cb84e7790718 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:42.251789 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 206/407] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jul 13 23:34:42 2022] GET /identity/v3/groups/d63fd75f31294f00ad6c2cddf396c567 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:42.252792 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-b42799f6-f1ea-4f43-b6b4-68241e2ba3f4 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:42.254159 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-b42799f6-f1ea-4f43-b6b4-68241e2ba3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:42.263237 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ffa6e-6572-43dc-9399-cb84e7790718 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:42.339227 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 202/408] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:34:42.366111 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42799f6-f1ea-4f43-b6b4-68241e2ba3f4 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:42.384427 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ffa6e-6572-43dc-9399-cb84e7790718 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:42.402022 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:42.431528 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7dd4b-ac03-4b66-8a7a-aa7e506fffa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:42.433384 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7dd4b-ac03-4b66-8a7a-aa7e506fffa9 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:42.434478 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7dd4b-ac03-4b66-8a7a-aa7e506fffa9 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:42.434762 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7dd4b-ac03-4b66-8a7a-aa7e506fffa9 None admin] PATH_INFO: `/v3/projects/b360f1c130384ed8a57179e36d9b4f7d` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:42.436168 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7dd4b-ac03-4b66-8a7a-aa7e506fffa9 None admin] RBAC: Authorizing `identity:get_project(project_id=b360f1c130384ed8a57179e36d9b4f7d)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:42.438144 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7dd4b-ac03-4b66-8a7a-aa7e506fffa9 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:42.439551 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 207/409] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 13 23:34:42 2022] GET /identity/v3/projects/b360f1c130384ed8a57179e36d9b4f7d => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:34:42.446923 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7dd4b-ac03-4b66-8a7a-aa7e506fffa9 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:42.512016 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:42.527333 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42799f6-f1ea-4f43-b6b4-68241e2ba3f4 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:42.593614 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ea3c8-1211-432a-be39-3c28f028e11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:42.594485 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ea3c8-1211-432a-be39-3c28f028e11e None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:42.594813 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ea3c8-1211-432a-be39-3c28f028e11e None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:42.595036 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7dd4b-ac03-4b66-8a7a-aa7e506fffa9 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:42.595395 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ea3c8-1211-432a-be39-3c28f028e11e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:42.623438 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ea3c8-1211-432a-be39-3c28f028e11e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:34:42.631589 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-ba3ea3c8-1211-432a-be39-3c28f028e11e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 23:34:42.631589 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:42.631589 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:42.631589 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:42.631589 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:42.631589 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:42.631589 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:42.631589 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:42.631589 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:42.631589 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:42.631589 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:42.631589 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:42.631589 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:34:42.631589 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:34:42.631589 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:34:42.631589 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:34:42.632459 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:34:42.632459 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:34:42.632459 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:34:42.632459 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:34:42.632459 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:42.632459 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:42.632459 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:42.632459 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:42.632459 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:42.632459 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:42.632459 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:42.632459 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:42.632459 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:42.632459 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:42.632459 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:42.632459 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:42.633280 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:42.633280 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:42.633280 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:42.633280 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:42.633280 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:34:42.633280 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:34:42.633280 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:34:42.633280 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:34:42.633280 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:34:42.633280 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:34:42.633280 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 23:34:42.633280 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:34:42.644475 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 203/410] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 13 23:34:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 23:34:42.654098 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ea3c8-1211-432a-be39-3c28f028e11e None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:42.659055 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a209de3-fb58-4e58-a4e0-d4d423dc5a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:42.660164 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a209de3-fb58-4e58-a4e0-d4d423dc5a3a None admin] REQUEST_METHOD: `PUT` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:42.664891 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a209de3-fb58-4e58-a4e0-d4d423dc5a3a None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:42.665450 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a209de3-fb58-4e58-a4e0-d4d423dc5a3a None admin] PATH_INFO: `/v3/projects/b360f1c130384ed8a57179e36d9b4f7d/groups/d63fd75f31294f00ad6c2cddf396c567/roles/a27ce0a47b0a4f9bac8c6e78d9da4278` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:42.670278 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a209de3-fb58-4e58-a4e0-d4d423dc5a3a None admin] RBAC: Authorizing `identity:create_grant(project_id=b360f1c130384ed8a57179e36d9b4f7d, group_id=d63fd75f31294f00ad6c2cddf396c567, role_id=a27ce0a47b0a4f9bac8c6e78d9da4278)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:42.671953 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a209de3-fb58-4e58-a4e0-d4d423dc5a3a None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:42.695167 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 208/411] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Jul 13 23:34:42 2022] PUT /identity/v3/projects/b360f1c130384ed8a57179e36d9b4f7d/groups/d63fd75f31294f00ad6c2cddf396c567/roles/a27ce0a47b0a4f9bac8c6e78d9da4278 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 23:34:42.823033 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ea3c8-1211-432a-be39-3c28f028e11e None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:42.862018 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b5335-ad65-407a-8e23-5171ee82903f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:42.862947 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b5335-ad65-407a-8e23-5171ee82903f None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:42.863405 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b5335-ad65-407a-8e23-5171ee82903f None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:42.863827 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b5335-ad65-407a-8e23-5171ee82903f None admin] PATH_INFO: `/v3/roles` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:42.864723 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b5335-ad65-407a-8e23-5171ee82903f None admin] RBAC: Adding query filter params (name=admin) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:42.865191 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b5335-ad65-407a-8e23-5171ee82903f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:42.866794 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b5335-ad65-407a-8e23-5171ee82903f None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:42.881198 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 204/412] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:34:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:42.882961 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a209de3-fb58-4e58-a4e0-d4d423dc5a3a None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:42.942705 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:42.964265 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609312ea-3a00-4e44-8880-2e605d1e1adc None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:42.964721 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609312ea-3a00-4e44-8880-2e605d1e1adc None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:42.965245 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609312ea-3a00-4e44-8880-2e605d1e1adc None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:42.966882 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 205/413] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 23:34:42.973956 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06c4eb-0882-4857-bf26-5e05f31aa3c6 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:42.974252 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06c4eb-0882-4857-bf26-5e05f31aa3c6 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:42.974511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06c4eb-0882-4857-bf26-5e05f31aa3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:42.998448 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-9f06c4eb-0882-4857-bf26-5e05f31aa3c6 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:43.000803 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-9f06c4eb-0882-4857-bf26-5e05f31aa3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:43.012357 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:43.068065 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a209de3-fb58-4e58-a4e0-d4d423dc5a3a None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:43.110814 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b937fd3-64d1-44a2-a2b1-0808e8361328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:43.112180 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b937fd3-64d1-44a2-a2b1-0808e8361328 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:43.112768 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b937fd3-64d1-44a2-a2b1-0808e8361328 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:43.113310 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b937fd3-64d1-44a2-a2b1-0808e8361328 None admin] PATH_INFO: `/v3/groups/4f5553eeba784c3fba520d524186a50f` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:43.114741 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b937fd3-64d1-44a2-a2b1-0808e8361328 None admin] RBAC: Authorizing `identity:get_group(group_id=4f5553eeba784c3fba520d524186a50f)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:43.116475 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b937fd3-64d1-44a2-a2b1-0808e8361328 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:43.124842 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 206/414] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 23:34:43.125016 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 209/415] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jul 13 23:34:42 2022] GET /identity/v3/groups/4f5553eeba784c3fba520d524186a50f => generated 229 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:43.131884 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06c4eb-0882-4857-bf26-5e05f31aa3c6 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:43.149963 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b937fd3-64d1-44a2-a2b1-0808e8361328 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:43.288296 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06c4eb-0882-4857-bf26-5e05f31aa3c6 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:43.314004 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b937fd3-64d1-44a2-a2b1-0808e8361328 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:43.331170 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ceeb1-c0e0-4ccb-885b-b671ef66a1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:43.333783 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ceeb1-c0e0-4ccb-885b-b671ef66a1a2 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:43.334323 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:43.336527 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ceeb1-c0e0-4ccb-885b-b671ef66a1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:43.337050 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ceeb1-c0e0-4ccb-885b-b671ef66a1a2 None admin] PATH_INFO: `/v3/projects/f6c258143da34685aa94a405e9ab3d07` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:43.340878 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ceeb1-c0e0-4ccb-885b-b671ef66a1a2 None admin] RBAC: Authorizing `identity:get_project(project_id=f6c258143da34685aa94a405e9ab3d07)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:43.344554 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ceeb1-c0e0-4ccb-885b-b671ef66a1a2 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:43.348293 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 207/416] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 13 23:34:43 2022] GET /identity/v3/projects/f6c258143da34685aa94a405e9ab3d07 => generated 344 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:43.356499 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ceeb1-c0e0-4ccb-885b-b671ef66a1a2 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:43.372139 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0e46a-a624-4bdc-adff-b4582e1de885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:43.373824 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0e46a-a624-4bdc-adff-b4582e1de885 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:43.374344 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0e46a-a624-4bdc-adff-b4582e1de885 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:43.374837 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0e46a-a624-4bdc-adff-b4582e1de885 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:43.383320 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:43.390423 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d0e46a-a624-4bdc-adff-b4582e1de885 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:34:43.400044 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-21d0e46a-a624-4bdc-adff-b4582e1de885 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 23:34:43.400044 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:43.400044 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:43.400044 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:43.400044 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:43.400044 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:43.400044 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:43.400044 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:43.400044 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:43.400044 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:43.400044 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:43.400044 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:43.400044 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:34:43.400044 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:34:43.400044 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:34:43.400044 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:34:43.400970 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:34:43.400970 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:34:43.400970 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:34:43.400970 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:34:43.400970 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:43.400970 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:43.400970 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:43.400970 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:43.400970 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:43.400970 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:43.400970 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:43.400970 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:43.400970 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:43.400970 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:43.400970 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:43.400970 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:43.402912 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:43.402912 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:43.402912 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:43.402912 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:43.402912 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:34:43.402912 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:34:43.402912 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:34:43.402912 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:34:43.402912 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:34:43.402912 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:34:43.402912 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 23:34:43.402912 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:34:43.410957 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 210/417] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jul 13 23:34:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 23:34:43.412674 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0e46a-a624-4bdc-adff-b4582e1de885 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:43.535322 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ceeb1-c0e0-4ccb-885b-b671ef66a1a2 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:43.544984 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0e46a-a624-4bdc-adff-b4582e1de885 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:43.593758 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610d5b6-4e12-4dde-8ba4-ee2775c30b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:43.594865 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610d5b6-4e12-4dde-8ba4-ee2775c30b30 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:43.595304 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610d5b6-4e12-4dde-8ba4-ee2775c30b30 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:43.596221 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610d5b6-4e12-4dde-8ba4-ee2775c30b30 None admin] PATH_INFO: `/v3/roles` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:43.596619 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b0e13-87b8-4121-a4b9-a9d82209d6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:43.597619 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d610d5b6-4e12-4dde-8ba4-ee2775c30b30 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:43.597735 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b0e13-87b8-4121-a4b9-a9d82209d6a9 None admin] REQUEST_METHOD: `PUT` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:43.598117 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b0e13-87b8-4121-a4b9-a9d82209d6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:43.598320 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d610d5b6-4e12-4dde-8ba4-ee2775c30b30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:43.598590 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b0e13-87b8-4121-a4b9-a9d82209d6a9 None admin] PATH_INFO: `/v3/projects/f6c258143da34685aa94a405e9ab3d07/groups/4f5553eeba784c3fba520d524186a50f/roles/46deff0e06964626a5600c9641454603` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:43.600223 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d610d5b6-4e12-4dde-8ba4-ee2775c30b30 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:43.600783 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b0e13-87b8-4121-a4b9-a9d82209d6a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6c258143da34685aa94a405e9ab3d07, group_id=4f5553eeba784c3fba520d524186a50f, role_id=46deff0e06964626a5600c9641454603)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:43.608381 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b0e13-87b8-4121-a4b9-a9d82209d6a9 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:43.614084 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 211/418] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 13 23:34:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:43.619947 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610d5b6-4e12-4dde-8ba4-ee2775c30b30 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:43.637073 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 208/419] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Jul 13 23:34:43 2022] PUT /identity/v3/projects/f6c258143da34685aa94a405e9ab3d07/groups/4f5553eeba784c3fba520d524186a50f/roles/46deff0e06964626a5600c9641454603 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 23:34:43.676344 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:43.748084 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610d5b6-4e12-4dde-8ba4-ee2775c30b30 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:43.793098 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c53fd-8eea-41c2-ba69-049c33ee02e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:43.793690 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c53fd-8eea-41c2-ba69-049c33ee02e0 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:43.793977 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c53fd-8eea-41c2-ba69-049c33ee02e0 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:43.794253 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c53fd-8eea-41c2-ba69-049c33ee02e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:43.873709 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335c53fd-8eea-41c2-ba69-049c33ee02e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:43.875166 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335c53fd-8eea-41c2-ba69-049c33ee02e0 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:43.907405 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:43.989756 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 212/420] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 13 23:34:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 13 23:34:43.996238 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b0e13-87b8-4121-a4b9-a9d82209d6a9 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:44.078158 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:44.113256 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b0e13-87b8-4121-a4b9-a9d82209d6a9 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:44.169768 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab7dba-b057-4a85-9faa-e961d9f7cc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:44.170646 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab7dba-b057-4a85-9faa-e961d9f7cc44 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:44.170934 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab7dba-b057-4a85-9faa-e961d9f7cc44 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:44.171241 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab7dba-b057-4a85-9faa-e961d9f7cc44 None admin] PATH_INFO: `/v3/projects/815dfc6ab25b4cac9e72ec762bd3d170` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:44.172464 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab7dba-b057-4a85-9faa-e961d9f7cc44 None admin] RBAC: Authorizing `identity:get_project(project_id=815dfc6ab25b4cac9e72ec762bd3d170)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:44.174048 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab7dba-b057-4a85-9faa-e961d9f7cc44 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:44.175910 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 209/421] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 13 23:34:43 2022] GET /identity/v3/projects/815dfc6ab25b4cac9e72ec762bd3d170 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:44.182132 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c53fd-8eea-41c2-ba69-049c33ee02e0 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:44.321357 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c53fd-8eea-41c2-ba69-049c33ee02e0 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:44.364439 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:44.373560 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7991ae2-97d5-47fe-984e-406431a6914b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:44.374501 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7991ae2-97d5-47fe-984e-406431a6914b None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:44.374795 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7991ae2-97d5-47fe-984e-406431a6914b None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:44.375074 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7991ae2-97d5-47fe-984e-406431a6914b None admin] PATH_INFO: `/v3/groups/d63fd75f31294f00ad6c2cddf396c567` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:44.376326 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7991ae2-97d5-47fe-984e-406431a6914b None admin] RBAC: Authorizing `identity:get_group(group_id=d63fd75f31294f00ad6c2cddf396c567)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:44.377878 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7991ae2-97d5-47fe-984e-406431a6914b None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:44.379692 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 213/422] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jul 13 23:34:44 2022] GET /identity/v3/groups/d63fd75f31294f00ad6c2cddf396c567 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:44.386042 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab7dba-b057-4a85-9faa-e961d9f7cc44 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:44.530950 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab7dba-b057-4a85-9faa-e961d9f7cc44 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:44.576308 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f90816-a9c5-4ecc-bfd0-36ce6bf1b64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:44.577425 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f90816-a9c5-4ecc-bfd0-36ce6bf1b64d None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:44.577929 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f90816-a9c5-4ecc-bfd0-36ce6bf1b64d None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:44.578403 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f90816-a9c5-4ecc-bfd0-36ce6bf1b64d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:44.579442 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f90816-a9c5-4ecc-bfd0-36ce6bf1b64d None admin] RBAC: Adding query filter params (group.id=d63fd75f31294f00ad6c2cddf396c567, role.id=a27ce0a47b0a4f9bac8c6e78d9da4278, scope.project.id=815dfc6ab25b4cac9e72ec762bd3d170) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:44.579965 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f90816-a9c5-4ecc-bfd0-36ce6bf1b64d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:44.581671 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f90816-a9c5-4ecc-bfd0-36ce6bf1b64d None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:44.590563 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 210/423] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jul 13 23:34:44 2022] GET /identity/v3/role_assignments?group.id=d63fd75f31294f00ad6c2cddf396c567&scope.project.id=815dfc6ab25b4cac9e72ec762bd3d170&role.id=a27ce0a47b0a4f9bac8c6e78d9da4278 => generated 611 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:44.768837 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0ec58-005c-4987-929b-7603d8e30a22 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:44.769355 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0ec58-005c-4987-929b-7603d8e30a22 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:44.769431 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0ec58-005c-4987-929b-7603d8e30a22 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:44.771102 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 214/424] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:44.777151 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6869b96-9a9d-4eab-b775-9cfbe88ac5f8 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:44.777674 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6869b96-9a9d-4eab-b775-9cfbe88ac5f8 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:44.777808 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6869b96-9a9d-4eab-b775-9cfbe88ac5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:44.783057 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:44.805126 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-c6869b96-9a9d-4eab-b775-9cfbe88ac5f8 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:44.806340 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-c6869b96-9a9d-4eab-b775-9cfbe88ac5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:44.882969 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 211/425] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:34:44.911639 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0ec58-005c-4987-929b-7603d8e30a22 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:44.956556 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a75eb1-541d-4b88-80e8-3e09199a7a65 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:44.956896 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a75eb1-541d-4b88-80e8-3e09199a7a65 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:44.957153 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a75eb1-541d-4b88-80e8-3e09199a7a65 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:44.959493 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 212/426] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 23:34:44.967469 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d12e62-b5bd-4c9a-8fcf-c30492f914c2 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:44.967763 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d12e62-b5bd-4c9a-8fcf-c30492f914c2 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:44.968352 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d12e62-b5bd-4c9a-8fcf-c30492f914c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:44.994142 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-65d12e62-b5bd-4c9a-8fcf-c30492f914c2 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:44.995415 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-65d12e62-b5bd-4c9a-8fcf-c30492f914c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:45.048052 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0ec58-005c-4987-929b-7603d8e30a22 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:45.084990 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 213/427] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 23:34:45.106846 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908b1c6-95e3-43aa-af54-9a3e9e4f65bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:45.107644 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908b1c6-95e3-43aa-af54-9a3e9e4f65bc None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:45.107925 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908b1c6-95e3-43aa-af54-9a3e9e4f65bc None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:45.108197 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908b1c6-95e3-43aa-af54-9a3e9e4f65bc None admin] PATH_INFO: `/v3/roles/member` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:45.112359 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d12e62-b5bd-4c9a-8fcf-c30492f914c2 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:45.121404 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e908b1c6-95e3-43aa-af54-9a3e9e4f65bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:34:45.129991 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-e908b1c6-95e3-43aa-af54-9a3e9e4f65bc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 23:34:45.129991 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:45.129991 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:45.129991 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:45.129991 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:45.129991 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:45.129991 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:45.129991 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:45.129991 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:45.129991 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:45.129991 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:45.129991 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:45.129991 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:34:45.129991 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:34:45.129991 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:34:45.129991 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:34:45.130882 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:34:45.130882 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:34:45.130882 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:34:45.130882 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:34:45.130882 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:45.130882 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:45.130882 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:45.130882 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:45.130882 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:45.130882 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:45.130882 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:45.130882 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:45.130882 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:45.130882 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:45.130882 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:45.130882 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:45.131691 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:45.131691 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:45.131691 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:45.131691 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:45.131691 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:34:45.131691 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:34:45.131691 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:34:45.131691 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:34:45.131691 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:34:45.131691 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:34:45.131691 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 23:34:45.131691 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:34:45.131691 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 215/428] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:34:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:45.138186 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908b1c6-95e3-43aa-af54-9a3e9e4f65bc None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:45.181876 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:45.207279 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:45.225461 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d12e62-b5bd-4c9a-8fcf-c30492f914c2 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:45.252083 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908b1c6-95e3-43aa-af54-9a3e9e4f65bc None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:45.266772 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1f580-bee5-4f76-9880-471e0c8c11de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:45.267682 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1f580-bee5-4f76-9880-471e0c8c11de None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:45.267972 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1f580-bee5-4f76-9880-471e0c8c11de None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:45.268245 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1f580-bee5-4f76-9880-471e0c8c11de None admin] PATH_INFO: `/v3/roles/member` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:45.280991 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1f580-bee5-4f76-9880-471e0c8c11de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:34:45.289370 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-d5f1f580-bee5-4f76-9880-471e0c8c11de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 23:34:45.289370 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:45.289370 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:45.289370 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:45.289370 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:45.289370 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:45.289370 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:45.289370 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:45.289370 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:45.289370 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:45.289370 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:45.289370 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:45.289370 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:34:45.289370 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:34:45.289370 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:34:45.289370 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:34:45.290234 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:34:45.290234 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:34:45.290234 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:34:45.290234 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:34:45.290234 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:45.290234 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:45.290234 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:45.290234 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:45.290234 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:45.290234 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:45.290234 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:45.290234 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:45.290234 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:45.290234 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:45.290234 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:45.290234 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:45.291030 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:45.291030 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:45.291030 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:45.291030 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:45.291030 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:34:45.291030 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:34:45.291030 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:34:45.291030 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:34:45.291030 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:34:45.291030 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:34:45.291030 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 23:34:45.291030 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:34:45.294218 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7f4a8-d197-4151-a534-0065fcee0218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:45.295110 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7f4a8-d197-4151-a534-0065fcee0218 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:45.295603 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7f4a8-d197-4151-a534-0065fcee0218 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:45.296237 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7f4a8-d197-4151-a534-0065fcee0218 None admin] PATH_INFO: `/v3/roles` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:45.296463 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 214/429] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:34:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:45.297379 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1f580-bee5-4f76-9880-471e0c8c11de None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:45.297672 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb7f4a8-d197-4151-a534-0065fcee0218 None admin] RBAC: Adding query filter params (name=member) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:45.298401 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb7f4a8-d197-4151-a534-0065fcee0218 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:45.300074 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb7f4a8-d197-4151-a534-0065fcee0218 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:45.315104 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 216/430] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 13 23:34:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:34:45.316719 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7f4a8-d197-4151-a534-0065fcee0218 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:45.424098 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1f580-bee5-4f76-9880-471e0c8c11de None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:45.429785 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7f4a8-d197-4151-a534-0065fcee0218 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:45.447714 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:45.457359 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:45.464166 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475a796-c49e-4848-9359-7e9109d3a056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:45.465180 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475a796-c49e-4848-9359-7e9109d3a056 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:45.465762 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475a796-c49e-4848-9359-7e9109d3a056 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:45.466248 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475a796-c49e-4848-9359-7e9109d3a056 None admin] PATH_INFO: `/v3/roles` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:45.467185 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3475a796-c49e-4848-9359-7e9109d3a056 None admin] RBAC: Adding query filter params (name=member) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:45.467690 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3475a796-c49e-4848-9359-7e9109d3a056 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:45.469394 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3475a796-c49e-4848-9359-7e9109d3a056 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:45.470573 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f6ea6-041b-4e76-860e-3c87970f2257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:45.471240 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f6ea6-041b-4e76-860e-3c87970f2257 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:45.471497 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f6ea6-041b-4e76-860e-3c87970f2257 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:45.471772 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f6ea6-041b-4e76-860e-3c87970f2257 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:45.479633 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 215/431] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 13 23:34:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:45.484927 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475a796-c49e-4848-9359-7e9109d3a056 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:45.546862 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f6ea6-041b-4e76-860e-3c87970f2257 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:45.548337 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f6ea6-041b-4e76-860e-3c87970f2257 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:45.615256 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475a796-c49e-4848-9359-7e9109d3a056 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:45.654431 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6de81-340a-431a-aab9-1b6ad64cee48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:45.655477 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6de81-340a-431a-aab9-1b6ad64cee48 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:45.656029 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6de81-340a-431a-aab9-1b6ad64cee48 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:45.656507 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6de81-340a-431a-aab9-1b6ad64cee48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:45.660889 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 217/432] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 13 23:34:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 13 23:34:45.666040 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f6ea6-041b-4e76-860e-3c87970f2257 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:45.690530 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:45.719906 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:45.737773 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6de81-340a-431a-aab9-1b6ad64cee48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:45.739547 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6de81-340a-431a-aab9-1b6ad64cee48 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:45.774992 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f6ea6-041b-4e76-860e-3c87970f2257 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:45.810036 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e957c63-94af-4037-921c-08f32e0721a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:45.811011 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e957c63-94af-4037-921c-08f32e0721a6 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:45.811382 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e957c63-94af-4037-921c-08f32e0721a6 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:45.811654 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e957c63-94af-4037-921c-08f32e0721a6 None admin] PATH_INFO: `/v3/projects/815dfc6ab25b4cac9e72ec762bd3d170` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:45.812839 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e957c63-94af-4037-921c-08f32e0721a6 None admin] RBAC: Authorizing `identity:get_project(project_id=815dfc6ab25b4cac9e72ec762bd3d170)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:45.814273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e957c63-94af-4037-921c-08f32e0721a6 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:45.816320 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 218/433] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 13 23:34:45 2022] GET /identity/v3/projects/815dfc6ab25b4cac9e72ec762bd3d170 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:34:45.817526 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac26488-8b99-44e3-b3eb-1d2dfcebc046 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:45.817809 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac26488-8b99-44e3-b3eb-1d2dfcebc046 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:45.818084 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac26488-8b99-44e3-b3eb-1d2dfcebc046 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:45.820867 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 219/434] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:45.822841 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac26488-8b99-44e3-b3eb-1d2dfcebc046 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:45.850168 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 216/435] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 13 23:34:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 13 23:34:45.851430 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bc408-1a03-4cb3-9377-089260efb5b6 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:45.851718 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bc408-1a03-4cb3-9377-089260efb5b6 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:45.851992 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bc408-1a03-4cb3-9377-089260efb5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:45.869680 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-b31bc408-1a03-4cb3-9377-089260efb5b6 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:45.871623 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-b31bc408-1a03-4cb3-9377-089260efb5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:45.924094 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:45.936033 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac26488-8b99-44e3-b3eb-1d2dfcebc046 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:45.943882 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 217/436] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:34:45.949375 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31bc408-1a03-4cb3-9377-089260efb5b6 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:45.961823 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:45.978103 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002df66-759a-4e08-bb44-76fa73ad5d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:45.979857 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002df66-759a-4e08-bb44-76fa73ad5d52 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:45.980224 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002df66-759a-4e08-bb44-76fa73ad5d52 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:45.980410 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002df66-759a-4e08-bb44-76fa73ad5d52 None admin] PATH_INFO: `/v3/groups/d63fd75f31294f00ad6c2cddf396c567` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:45.981720 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7002df66-759a-4e08-bb44-76fa73ad5d52 None admin] RBAC: Authorizing `identity:get_group(group_id=d63fd75f31294f00ad6c2cddf396c567)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:45.983151 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7002df66-759a-4e08-bb44-76fa73ad5d52 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:45.984959 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 220/437] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jul 13 23:34:45 2022] GET /identity/v3/groups/d63fd75f31294f00ad6c2cddf396c567 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:45.985561 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002df66-759a-4e08-bb44-76fa73ad5d52 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:46.065686 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31bc408-1a03-4cb3-9377-089260efb5b6 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:46.090950 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002df66-759a-4e08-bb44-76fa73ad5d52 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:46.105658 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17a452-2898-44c2-89cf-66b64e8d2736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:46.106770 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17a452-2898-44c2-89cf-66b64e8d2736 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:46.107046 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17a452-2898-44c2-89cf-66b64e8d2736 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:46.107315 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17a452-2898-44c2-89cf-66b64e8d2736 None admin] PATH_INFO: `/v3/projects/b360f1c130384ed8a57179e36d9b4f7d` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:46.108569 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17a452-2898-44c2-89cf-66b64e8d2736 None admin] RBAC: Authorizing `identity:get_project(project_id=b360f1c130384ed8a57179e36d9b4f7d)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:46.110048 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17a452-2898-44c2-89cf-66b64e8d2736 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:46.116441 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 218/438] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 13 23:34:45 2022] GET /identity/v3/projects/b360f1c130384ed8a57179e36d9b4f7d => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:46.116441 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17a452-2898-44c2-89cf-66b64e8d2736 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:46.135055 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77388915-3eb2-47cf-9fe5-fad9fdcde674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:46.135815 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77388915-3eb2-47cf-9fe5-fad9fdcde674 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:46.136282 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77388915-3eb2-47cf-9fe5-fad9fdcde674 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:46.136569 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77388915-3eb2-47cf-9fe5-fad9fdcde674 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:46.148304 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77388915-3eb2-47cf-9fe5-fad9fdcde674 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:34:46.157363 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-77388915-3eb2-47cf-9fe5-fad9fdcde674 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 23:34:46.157363 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:46.157363 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:46.157363 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:46.157363 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:46.157363 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:46.157363 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:46.157363 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:46.157363 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:46.157363 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:46.157363 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:46.157363 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:46.157363 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:34:46.157363 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:34:46.157363 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:34:46.157363 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:34:46.158438 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:34:46.158438 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:34:46.158438 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:34:46.158438 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:34:46.158438 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:46.158438 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:46.158438 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:46.158438 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:46.158438 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:46.158438 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:46.158438 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:46.158438 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:46.158438 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:46.158438 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:46.158438 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:46.158438 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:46.159233 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:46.159233 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:46.159233 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:46.159233 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:46.159233 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:34:46.159233 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:34:46.159233 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:34:46.159233 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:34:46.159233 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:34:46.159233 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:34:46.159233 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 23:34:46.159233 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:34:46.159850 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 221/439] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jul 13 23:34:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:46.160269 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77388915-3eb2-47cf-9fe5-fad9fdcde674 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:46.185758 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:46.211417 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:46.234486 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17a452-2898-44c2-89cf-66b64e8d2736 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:46.270748 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6a176-d6fe-44cc-850b-77a3068a08f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:46.271401 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6a176-d6fe-44cc-850b-77a3068a08f3 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:46.271708 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6a176-d6fe-44cc-850b-77a3068a08f3 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:46.271977 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6a176-d6fe-44cc-850b-77a3068a08f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:46.272885 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab6a176-d6fe-44cc-850b-77a3068a08f3 None admin] RBAC: Adding query filter params (group.id=d63fd75f31294f00ad6c2cddf396c567, role.id=69842edf01cf43eb814bb066f9652f48, scope.project.id=815dfc6ab25b4cac9e72ec762bd3d170) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:46.273133 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab6a176-d6fe-44cc-850b-77a3068a08f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:46.274549 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab6a176-d6fe-44cc-850b-77a3068a08f3 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:46.288851 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 219/440] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jul 13 23:34:46 2022] GET /identity/v3/role_assignments?group.id=d63fd75f31294f00ad6c2cddf396c567&scope.project.id=815dfc6ab25b4cac9e72ec762bd3d170&role.id=69842edf01cf43eb814bb066f9652f48 => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:46.288851 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6a176-d6fe-44cc-850b-77a3068a08f3 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:46.289164 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77388915-3eb2-47cf-9fe5-fad9fdcde674 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:46.328604 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05734c9-5efe-4a4f-9a68-5e26bf9b9185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:46.329637 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05734c9-5efe-4a4f-9a68-5e26bf9b9185 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:46.330015 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05734c9-5efe-4a4f-9a68-5e26bf9b9185 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:46.330471 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05734c9-5efe-4a4f-9a68-5e26bf9b9185 None admin] PATH_INFO: `/v3/groups/d63fd75f31294f00ad6c2cddf396c567` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:46.331890 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05734c9-5efe-4a4f-9a68-5e26bf9b9185 None admin] RBAC: Authorizing `identity:get_group(group_id=d63fd75f31294f00ad6c2cddf396c567)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:46.333504 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05734c9-5efe-4a4f-9a68-5e26bf9b9185 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:46.340123 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 222/441] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jul 13 23:34:46 2022] GET /identity/v3/groups/d63fd75f31294f00ad6c2cddf396c567 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:46.341876 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05734c9-5efe-4a4f-9a68-5e26bf9b9185 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:46.430976 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6a176-d6fe-44cc-850b-77a3068a08f3 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:46.442175 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:46.461044 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05734c9-5efe-4a4f-9a68-5e26bf9b9185 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:46.486222 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663f694-aadc-48e7-a746-99ebf39dbeee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:46.486915 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663f694-aadc-48e7-a746-99ebf39dbeee None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:46.487202 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663f694-aadc-48e7-a746-99ebf39dbeee None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:46.487480 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663f694-aadc-48e7-a746-99ebf39dbeee None admin] PATH_INFO: `/v3/roles` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:46.488322 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3663f694-aadc-48e7-a746-99ebf39dbeee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:46.488565 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3663f694-aadc-48e7-a746-99ebf39dbeee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:46.490056 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3663f694-aadc-48e7-a746-99ebf39dbeee None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:46.500886 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 220/442] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 13 23:34:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:46.507434 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663f694-aadc-48e7-a746-99ebf39dbeee None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:46.516612 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c5225-3527-46d5-a865-06117b5b726a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:46.517304 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c5225-3527-46d5-a865-06117b5b726a None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:46.518056 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c5225-3527-46d5-a865-06117b5b726a None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:46.518349 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c5225-3527-46d5-a865-06117b5b726a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:46.519186 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883c5225-3527-46d5-a865-06117b5b726a None admin] RBAC: Adding query filter params (group.id=d63fd75f31294f00ad6c2cddf396c567, role.id=69842edf01cf43eb814bb066f9652f48, scope.project.id=b360f1c130384ed8a57179e36d9b4f7d) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:46.519497 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883c5225-3527-46d5-a865-06117b5b726a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:46.523078 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883c5225-3527-46d5-a865-06117b5b726a None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:46.529328 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:46.531574 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 223/443] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jul 13 23:34:46 2022] GET /identity/v3/role_assignments?group.id=d63fd75f31294f00ad6c2cddf396c567&scope.project.id=b360f1c130384ed8a57179e36d9b4f7d&role.id=69842edf01cf43eb814bb066f9652f48 => generated 611 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:46.634623 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663f694-aadc-48e7-a746-99ebf39dbeee None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:46.646786 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375230d4-e58c-4243-8bdc-08f97d053dda None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:46.647074 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375230d4-e58c-4243-8bdc-08f97d053dda None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:46.647361 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375230d4-e58c-4243-8bdc-08f97d053dda None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:46.649137 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 224/444] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 23:34:46.655484 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787f592-faed-46da-b31e-c1e0088d1a1c None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:46.655772 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787f592-faed-46da-b31e-c1e0088d1a1c None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:46.656054 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787f592-faed-46da-b31e-c1e0088d1a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:46.681710 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-5787f592-faed-46da-b31e-c1e0088d1a1c None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:46.682977 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-5787f592-faed-46da-b31e-c1e0088d1a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:46.685166 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ca8d1-213f-40e7-aedd-28515feef036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:46.685844 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ca8d1-213f-40e7-aedd-28515feef036 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:46.686131 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ca8d1-213f-40e7-aedd-28515feef036 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:46.686410 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ca8d1-213f-40e7-aedd-28515feef036 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:46.771782 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 225/445] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 23:34:46.780442 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8ca8d1-213f-40e7-aedd-28515feef036 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:46.782040 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8ca8d1-213f-40e7-aedd-28515feef036 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:46.796171 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:46.801020 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787f592-faed-46da-b31e-c1e0088d1a1c None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:46.896672 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:46.899371 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 221/446] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 13 23:34:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 23:34:46.905492 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ca8d1-213f-40e7-aedd-28515feef036 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:46.921511 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787f592-faed-46da-b31e-c1e0088d1a1c None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:46.968587 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34fe31-0858-4a73-9112-c4b2e59dcdc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:46.969354 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34fe31-0858-4a73-9112-c4b2e59dcdc2 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:46.969633 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34fe31-0858-4a73-9112-c4b2e59dcdc2 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:46.970031 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34fe31-0858-4a73-9112-c4b2e59dcdc2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:46.982259 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f34fe31-0858-4a73-9112-c4b2e59dcdc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:34:46.990998 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-3f34fe31-0858-4a73-9112-c4b2e59dcdc2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 23:34:46.990998 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:46.990998 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:46.990998 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:46.990998 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:46.990998 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:46.990998 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:46.990998 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:46.990998 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:46.990998 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:46.990998 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:46.990998 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:46.990998 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:34:46.990998 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:34:46.990998 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:34:46.990998 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:34:46.992007 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:34:46.992007 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:34:46.992007 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:34:46.992007 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:34:46.992007 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:46.992007 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:46.992007 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:46.992007 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:46.992007 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:46.992007 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:46.992007 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:46.992007 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:46.992007 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:46.992007 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:46.992007 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:46.992007 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:46.992804 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:46.992804 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:46.992804 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:46.992804 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:46.992804 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:34:46.992804 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:34:46.992804 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:34:46.992804 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:34:46.992804 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:34:46.992804 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:34:46.992804 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 23:34:46.992804 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:34:46.992804 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 226/447] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 13 23:34:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:46.998668 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34fe31-0858-4a73-9112-c4b2e59dcdc2 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:47.031432 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ca8d1-213f-40e7-aedd-28515feef036 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:47.042501 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:47.074597 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b295e5a-da5e-497a-98ca-dab09e05b2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:47.075028 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b295e5a-da5e-497a-98ca-dab09e05b2c6 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:47.075344 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b295e5a-da5e-497a-98ca-dab09e05b2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:47.075606 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b295e5a-da5e-497a-98ca-dab09e05b2c6 None admin] PATH_INFO: `/v3/projects/b360f1c130384ed8a57179e36d9b4f7d` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:47.077933 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b295e5a-da5e-497a-98ca-dab09e05b2c6 None admin] RBAC: Authorizing `identity:get_project(project_id=b360f1c130384ed8a57179e36d9b4f7d)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:47.079506 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b295e5a-da5e-497a-98ca-dab09e05b2c6 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:47.082168 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 222/448] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 13 23:34:46 2022] GET /identity/v3/projects/b360f1c130384ed8a57179e36d9b4f7d => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:34:47.087362 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b295e5a-da5e-497a-98ca-dab09e05b2c6 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:47.126885 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34fe31-0858-4a73-9112-c4b2e59dcdc2 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:47.169133 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38e2ec-635c-486e-a49f-96b2e76897aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:47.169854 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38e2ec-635c-486e-a49f-96b2e76897aa None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:47.170139 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38e2ec-635c-486e-a49f-96b2e76897aa None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:47.170416 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38e2ec-635c-486e-a49f-96b2e76897aa None admin] PATH_INFO: `/v3/roles` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:47.171160 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38e2ec-635c-486e-a49f-96b2e76897aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:47.171468 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38e2ec-635c-486e-a49f-96b2e76897aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:47.172874 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38e2ec-635c-486e-a49f-96b2e76897aa None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:47.181198 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 227/449] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:34:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:47.187469 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38e2ec-635c-486e-a49f-96b2e76897aa None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:47.190127 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:47.202605 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b295e5a-da5e-497a-98ca-dab09e05b2c6 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:47.237028 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919e29d-5bc3-47dc-a795-036139bc6f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:47.237796 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919e29d-5bc3-47dc-a795-036139bc6f24 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:47.238072 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919e29d-5bc3-47dc-a795-036139bc6f24 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:47.238339 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919e29d-5bc3-47dc-a795-036139bc6f24 None admin] PATH_INFO: `/v3/groups/d63fd75f31294f00ad6c2cddf396c567` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:47.239498 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0919e29d-5bc3-47dc-a795-036139bc6f24 None admin] RBAC: Authorizing `identity:get_group(group_id=d63fd75f31294f00ad6c2cddf396c567)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:47.240956 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0919e29d-5bc3-47dc-a795-036139bc6f24 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:47.242547 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 223/450] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jul 13 23:34:47 2022] GET /identity/v3/groups/d63fd75f31294f00ad6c2cddf396c567 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:34:47.249233 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919e29d-5bc3-47dc-a795-036139bc6f24 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:47.286877 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38e2ec-635c-486e-a49f-96b2e76897aa None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:47.293684 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:47.320607 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c6998-bc66-42db-90f3-b131de5c96f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:47.321267 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c6998-bc66-42db-90f3-b131de5c96f6 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:47.321545 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c6998-bc66-42db-90f3-b131de5c96f6 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:47.322165 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c6998-bc66-42db-90f3-b131de5c96f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:47.346499 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919e29d-5bc3-47dc-a795-036139bc6f24 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:47.380109 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188ca7c-1831-48c8-873b-719458a2b2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:47.380752 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188ca7c-1831-48c8-873b-719458a2b2ec None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:47.381067 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188ca7c-1831-48c8-873b-719458a2b2ec None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:47.381341 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188ca7c-1831-48c8-873b-719458a2b2ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:47.382157 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188ca7c-1831-48c8-873b-719458a2b2ec None admin] RBAC: Adding query filter params (group.id=d63fd75f31294f00ad6c2cddf396c567, role.id=a27ce0a47b0a4f9bac8c6e78d9da4278, scope.project.id=b360f1c130384ed8a57179e36d9b4f7d) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:47.382465 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188ca7c-1831-48c8-873b-719458a2b2ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:47.383892 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188ca7c-1831-48c8-873b-719458a2b2ec None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:47.388006 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c6998-bc66-42db-90f3-b131de5c96f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:47.389472 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c6998-bc66-42db-90f3-b131de5c96f6 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:47.390495 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 224/451] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jul 13 23:34:47 2022] GET /identity/v3/role_assignments?group.id=d63fd75f31294f00ad6c2cddf396c567&scope.project.id=b360f1c130384ed8a57179e36d9b4f7d&role.id=a27ce0a47b0a4f9bac8c6e78d9da4278 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:34:47.391281 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:47.498348 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 228/452] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 13 23:34:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 13 23:34:47.503827 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188ca7c-1831-48c8-873b-719458a2b2ec None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:47.617404 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188ca7c-1831-48c8-873b-719458a2b2ec None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:47.627461 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:47.654219 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd9d1a2-3706-4f84-b852-94949c6735f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:47.655085 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9d1a2-3706-4f84-b852-94949c6735f6 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:47.655362 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9d1a2-3706-4f84-b852-94949c6735f6 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:47.655633 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9d1a2-3706-4f84-b852-94949c6735f6 None admin] PATH_INFO: `/v3/projects/f6c258143da34685aa94a405e9ab3d07` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:47.656848 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd9d1a2-3706-4f84-b852-94949c6735f6 None admin] RBAC: Authorizing `identity:get_project(project_id=f6c258143da34685aa94a405e9ab3d07)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:47.658307 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd9d1a2-3706-4f84-b852-94949c6735f6 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:47.659989 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 225/453] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 13 23:34:47 2022] GET /identity/v3/projects/f6c258143da34685aa94a405e9ab3d07 => generated 344 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:47.665859 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c6998-bc66-42db-90f3-b131de5c96f6 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:47.774330 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c6998-bc66-42db-90f3-b131de5c96f6 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:47.775772 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:47.809979 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cad389-89b3-4d59-94b0-3ef6c570a5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:47.810828 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cad389-89b3-4d59-94b0-3ef6c570a5bd None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:47.811115 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cad389-89b3-4d59-94b0-3ef6c570a5bd None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:47.811395 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cad389-89b3-4d59-94b0-3ef6c570a5bd None admin] PATH_INFO: `/v3/groups/4f5553eeba784c3fba520d524186a50f` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:47.812550 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cad389-89b3-4d59-94b0-3ef6c570a5bd None admin] RBAC: Authorizing `identity:get_group(group_id=4f5553eeba784c3fba520d524186a50f)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:47.814023 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cad389-89b3-4d59-94b0-3ef6c570a5bd None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:47.815635 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 229/454] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jul 13 23:34:47 2022] GET /identity/v3/groups/4f5553eeba784c3fba520d524186a50f => generated 229 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:47.821496 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd9d1a2-3706-4f84-b852-94949c6735f6 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:47.923119 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd9d1a2-3706-4f84-b852-94949c6735f6 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:47.956389 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ed12a-5275-46ea-85b5-f50762927e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:47.957053 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ed12a-5275-46ea-85b5-f50762927e6f None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:47.957342 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ed12a-5275-46ea-85b5-f50762927e6f None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:47.957621 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ed12a-5275-46ea-85b5-f50762927e6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:47.958444 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ed12a-5275-46ea-85b5-f50762927e6f None admin] RBAC: Adding query filter params (group.id=4f5553eeba784c3fba520d524186a50f, role.id=46deff0e06964626a5600c9641454603, scope.project.id=f6c258143da34685aa94a405e9ab3d07) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:47.958758 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ed12a-5275-46ea-85b5-f50762927e6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:47.960181 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ed12a-5275-46ea-85b5-f50762927e6f None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:47.967809 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 226/455] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jul 13 23:34:47 2022] GET /identity/v3/role_assignments?group.id=4f5553eeba784c3fba520d524186a50f&scope.project.id=f6c258143da34685aa94a405e9ab3d07&role.id=46deff0e06964626a5600c9641454603 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:50.518565 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8e826-2380-4f00-b175-2c180394d684 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:50.519113 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8e826-2380-4f00-b175-2c180394d684 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:50.519113 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8e826-2380-4f00-b175-2c180394d684 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:50.526126 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 230/456] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:50.532564 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f8710-ce95-4d36-94af-53aaa3594f14 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:50.533230 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f8710-ce95-4d36-94af-53aaa3594f14 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:50.533230 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f8710-ce95-4d36-94af-53aaa3594f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:50.556622 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-bf1f8710-ce95-4d36-94af-53aaa3594f14 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:50.557891 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-bf1f8710-ce95-4d36-94af-53aaa3594f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:50.597485 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:50.638477 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 227/457] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:34:50.664047 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8e826-2380-4f00-b175-2c180394d684 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:50.717620 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655a6e2-33bb-45d0-a5b4-6c284c1a81b0 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:50.717946 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655a6e2-33bb-45d0-a5b4-6c284c1a81b0 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:50.718216 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655a6e2-33bb-45d0-a5b4-6c284c1a81b0 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:50.720195 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 228/458] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 23:34:50.725507 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b8d31-80f5-4350-880d-d1a8ff194a30 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:50.725889 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b8d31-80f5-4350-880d-d1a8ff194a30 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:50.726168 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b8d31-80f5-4350-880d-d1a8ff194a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:50.744220 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-af1b8d31-80f5-4350-880d-d1a8ff194a30 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:50.746122 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-af1b8d31-80f5-4350-880d-d1a8ff194a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:50.773395 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8e826-2380-4f00-b175-2c180394d684 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:50.816086 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b5648-7532-45bb-b8c4-68d48b27888d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:50.816906 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b5648-7532-45bb-b8c4-68d48b27888d None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:50.817278 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b5648-7532-45bb-b8c4-68d48b27888d None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:50.817562 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b5648-7532-45bb-b8c4-68d48b27888d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:50.818330 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 229/459] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 23:34:50.826199 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3172a-8a0b-43f7-ab20-9223e90d5f6c None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:50.826965 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3172a-8a0b-43f7-ab20-9223e90d5f6c None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:50.827320 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3172a-8a0b-43f7-ab20-9223e90d5f6c None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:50.833011 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 230/460] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:50 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:50.834315 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4044fe-1ba1-4fe3-949e-0052215621de None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:50.834469 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b5648-7532-45bb-b8c4-68d48b27888d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:50.834918 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4044fe-1ba1-4fe3-949e-0052215621de None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:50.835384 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4044fe-1ba1-4fe3-949e-0052215621de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:50.836169 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b5648-7532-45bb-b8c4-68d48b27888d None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:50.853424 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-dd4044fe-1ba1-4fe3-949e-0052215621de None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:50.854602 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-dd4044fe-1ba1-4fe3-949e-0052215621de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:50.857303 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-3d7b5648-7532-45bb-b8c4-68d48b27888d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:34:50.857303 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:50.857303 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:50.857303 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:50.857303 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:50.857303 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:50.857303 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:50.857303 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:50.857303 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:50.857303 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:50.857303 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:50.857303 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:50.857303 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:34:50.857303 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:34:50.857303 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:34:50.858156 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:34:50.858156 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:50.858156 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:50.858156 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:50.858156 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:50.858156 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:50.858156 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:50.858156 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:50.858156 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:50.858156 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:50.858156 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:50.858156 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:50.858156 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:50.858156 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:50.858156 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:50.858156 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:50.858156 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:50.859075 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:34:50.859075 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:34:50.859075 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:34:50.859075 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:34:50.859075 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 231/461] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:34:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:50.859352 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b5648-7532-45bb-b8c4-68d48b27888d None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:50.888462 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:50.929814 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 231/462] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:34:50.930691 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4044fe-1ba1-4fe3-949e-0052215621de None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:50.960576 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:50.986777 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b5648-7532-45bb-b8c4-68d48b27888d None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:51.025842 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717cb471-05fa-4e88-b45e-ef609f7fe91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:51.026567 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717cb471-05fa-4e88-b45e-ef609f7fe91f None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:51.026919 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717cb471-05fa-4e88-b45e-ef609f7fe91f None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:51.027721 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717cb471-05fa-4e88-b45e-ef609f7fe91f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:51.038910 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4044fe-1ba1-4fe3-949e-0052215621de None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:51.040548 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717cb471-05fa-4e88-b45e-ef609f7fe91f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:51.042893 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717cb471-05fa-4e88-b45e-ef609f7fe91f None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:51.062327 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-717cb471-05fa-4e88-b45e-ef609f7fe91f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:34:51.062327 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:51.062327 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:51.062327 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:51.062327 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:51.062327 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:51.062327 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:51.062327 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:51.062327 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:51.062327 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:51.062327 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:51.062327 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:51.062327 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:34:51.062327 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:34:51.062327 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:34:51.063190 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:34:51.063190 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:51.063190 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:51.063190 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:51.063190 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:51.063190 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:51.063190 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:51.063190 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:51.063190 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:51.063190 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:51.063190 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:51.063190 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:51.063190 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:51.063190 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:51.063190 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:51.063190 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:51.063190 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:51.064070 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:34:51.064070 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:34:51.064070 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:34:51.064070 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:34:51.064070 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 232/463] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:34:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:51.069422 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717cb471-05fa-4e88-b45e-ef609f7fe91f None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:51.076090 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ec370-d049-4a56-a883-a892dc748dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:51.076862 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ec370-d049-4a56-a883-a892dc748dcd None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:51.077155 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ec370-d049-4a56-a883-a892dc748dcd None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:51.077426 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ec370-d049-4a56-a883-a892dc748dcd None admin] PATH_INFO: `/v3/domains` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:51.078146 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70ec370-d049-4a56-a883-a892dc748dcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:51.078450 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70ec370-d049-4a56-a883-a892dc748dcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:51.080250 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70ec370-d049-4a56-a883-a892dc748dcd None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:51.093573 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 232/464] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:34:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:51.098561 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ec370-d049-4a56-a883-a892dc748dcd None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:51.149609 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:51.175237 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717cb471-05fa-4e88-b45e-ef609f7fe91f None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:51.191455 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:51.202338 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ec370-d049-4a56-a883-a892dc748dcd None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:51.209719 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8815c-2953-41d8-8642-440945856a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:51.210978 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8815c-2953-41d8-8642-440945856a93 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:51.211267 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8815c-2953-41d8-8642-440945856a93 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:51.211546 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8815c-2953-41d8-8642-440945856a93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:51.222688 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8815c-2953-41d8-8642-440945856a93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:51.224160 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8815c-2953-41d8-8642-440945856a93 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:51.237156 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46415ff-470e-40b9-8e10-d45931be5f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:51.237805 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46415ff-470e-40b9-8e10-d45931be5f6e None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:51.238086 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46415ff-470e-40b9-8e10-d45931be5f6e None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:51.238358 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46415ff-470e-40b9-8e10-d45931be5f6e None admin] PATH_INFO: `/v3/domains` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:51.239058 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46415ff-470e-40b9-8e10-d45931be5f6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:51.239359 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46415ff-470e-40b9-8e10-d45931be5f6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:51.240691 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46415ff-470e-40b9-8e10-d45931be5f6e None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:51.241975 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-ced8815c-2953-41d8-8642-440945856a93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:34:51.241975 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:51.241975 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:51.241975 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:51.241975 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:51.241975 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:51.241975 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:51.241975 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:51.241975 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:51.241975 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:51.241975 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:51.241975 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:51.241975 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:34:51.241975 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:34:51.241975 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:34:51.243004 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:34:51.243004 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:51.243004 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:51.243004 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:51.243004 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:51.243004 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:51.243004 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:51.243004 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:51.243004 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:51.243004 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:51.243004 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:51.243004 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:51.243004 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:51.243004 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:51.243004 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:51.243004 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:51.243004 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:51.244063 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:34:51.244063 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:34:51.244063 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:34:51.244063 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:34:51.248544 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 233/465] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:34:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:51.249539 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8815c-2953-41d8-8642-440945856a93 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:51.253072 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 233/466] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:34:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:51.254376 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134777d-3f1d-4ea6-8b15-f8d8f457e73f None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:51.254663 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134777d-3f1d-4ea6-8b15-f8d8f457e73f None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:51.254939 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134777d-3f1d-4ea6-8b15-f8d8f457e73f None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:51.256137 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 234/467] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:51.256847 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134777d-3f1d-4ea6-8b15-f8d8f457e73f None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:51.350604 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8815c-2953-41d8-8642-440945856a93 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:51.356458 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134777d-3f1d-4ea6-8b15-f8d8f457e73f None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:51.376126 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:51.385718 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc2436-39b8-4c46-bfc7-780e425c78d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:51.386996 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc2436-39b8-4c46-bfc7-780e425c78d7 None admin] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:51.387670 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc2436-39b8-4c46-bfc7-780e425c78d7 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:51.387961 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc2436-39b8-4c46-bfc7-780e425c78d7 None admin] PATH_INFO: `/v3/users` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:51.388666 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc2436-39b8-4c46-bfc7-780e425c78d7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:51.390148 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc2436-39b8-4c46-bfc7-780e425c78d7 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:51.391423 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb410c-2bf8-4880-b072-9c373b7ae4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:51.392071 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb410c-2bf8-4880-b072-9c373b7ae4b1 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:51.392353 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb410c-2bf8-4880-b072-9c373b7ae4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:51.392626 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb410c-2bf8-4880-b072-9c373b7ae4b1 None admin] PATH_INFO: `/v3/domains` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:51.393364 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bb410c-2bf8-4880-b072-9c373b7ae4b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:51.393665 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bb410c-2bf8-4880-b072-9c373b7ae4b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:51.394995 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bb410c-2bf8-4880-b072-9c373b7ae4b1 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:51.406537 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 235/468] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:34:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:51.407325 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb410c-2bf8-4880-b072-9c373b7ae4b1 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:51.409314 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 234/469] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jul 13 23:34:51 2022] POST /identity/v3/users => generated 246 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 23:34:51.410574 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42648415-b73d-4b9a-91d6-b2c80134d0a4 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:51.411034 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42648415-b73d-4b9a-91d6-b2c80134d0a4 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:51.411321 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42648415-b73d-4b9a-91d6-b2c80134d0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:51.424889 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:51.432678 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-42648415-b73d-4b9a-91d6-b2c80134d0a4 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:51.434523 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-42648415-b73d-4b9a-91d6-b2c80134d0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:51.516918 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 235/470] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:34:51.516918 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42648415-b73d-4b9a-91d6-b2c80134d0a4 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:51.546340 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb410c-2bf8-4880-b072-9c373b7ae4b1 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:51.587807 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe83bd-2644-4681-b90f-3bc3b1d4845d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:51.588784 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe83bd-2644-4681-b90f-3bc3b1d4845d None admin] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:51.589100 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe83bd-2644-4681-b90f-3bc3b1d4845d None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:51.589413 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe83bd-2644-4681-b90f-3bc3b1d4845d None admin] PATH_INFO: `/v3/users` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:51.590123 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe83bd-2644-4681-b90f-3bc3b1d4845d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:51.591560 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe83bd-2644-4681-b90f-3bc3b1d4845d None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:51.613392 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 236/471] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jul 13 23:34:51 2022] POST /identity/v3/users => generated 248 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 23:34:51.614973 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe83bd-2644-4681-b90f-3bc3b1d4845d None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:51.667336 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42648415-b73d-4b9a-91d6-b2c80134d0a4 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:51.684694 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:51.712272 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df119a-7108-4b4e-b254-b46721b19026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:51.713121 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df119a-7108-4b4e-b254-b46721b19026 None admin] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:51.713403 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df119a-7108-4b4e-b254-b46721b19026 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:51.713677 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df119a-7108-4b4e-b254-b46721b19026 None admin] PATH_INFO: `/v3/users` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:51.714475 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df119a-7108-4b4e-b254-b46721b19026 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:51.716108 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df119a-7108-4b4e-b254-b46721b19026 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:51.723649 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:51.747572 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 236/472] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jul 13 23:34:51 2022] POST /identity/v3/users => generated 248 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 23:34:51.779074 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe83bd-2644-4681-b90f-3bc3b1d4845d None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:51.818689 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76999930-d8b5-49c4-960d-0789c995495f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:51.819634 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76999930-d8b5-49c4-960d-0789c995495f None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:51.819995 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76999930-d8b5-49c4-960d-0789c995495f None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:51.820343 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76999930-d8b5-49c4-960d-0789c995495f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:51.836935 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76999930-d8b5-49c4-960d-0789c995495f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:51.838716 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76999930-d8b5-49c4-960d-0789c995495f None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:51.859821 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-76999930-d8b5-49c4-960d-0789c995495f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:34:51.859821 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:51.859821 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:51.859821 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:51.859821 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:51.859821 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:51.859821 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:51.859821 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:51.859821 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:51.859821 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:51.859821 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:51.859821 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:51.859821 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:34:51.859821 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:34:51.859821 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:34:51.860723 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:34:51.860723 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:51.860723 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:51.860723 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:51.860723 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:51.860723 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:51.860723 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:51.860723 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:51.860723 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:51.860723 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:51.860723 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:51.860723 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:51.860723 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:51.860723 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:51.860723 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:51.860723 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:51.860723 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:51.861715 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:34:51.861715 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:34:51.861715 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:34:51.861715 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:34:51.863023 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 237/473] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:34:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:51.868961 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df119a-7108-4b4e-b254-b46721b19026 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:51.984308 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df119a-7108-4b4e-b254-b46721b19026 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:52.021624 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abcc6c9-e2a3-4bea-a2ad-3f89e25ef983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:52.022295 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcc6c9-e2a3-4bea-a2ad-3f89e25ef983 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:52.022579 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcc6c9-e2a3-4bea-a2ad-3f89e25ef983 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:52.022858 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcc6c9-e2a3-4bea-a2ad-3f89e25ef983 None admin] PATH_INFO: `/v3/domains` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:52.023591 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abcc6c9-e2a3-4bea-a2ad-3f89e25ef983 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:52.023900 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abcc6c9-e2a3-4bea-a2ad-3f89e25ef983 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:52.025344 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abcc6c9-e2a3-4bea-a2ad-3f89e25ef983 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:52.038678 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 237/474] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:34:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:52.044915 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76999930-d8b5-49c4-960d-0789c995495f None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:52.156863 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76999930-d8b5-49c4-960d-0789c995495f None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:52.181728 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:52.194289 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1abc871-02c1-4354-a9e9-6c2667de39f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:52.195288 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abc871-02c1-4354-a9e9-6c2667de39f0 None admin] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:52.195792 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abc871-02c1-4354-a9e9-6c2667de39f0 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:52.196261 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abc871-02c1-4354-a9e9-6c2667de39f0 None admin] PATH_INFO: `/v3/users` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:52.197186 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1abc871-02c1-4354-a9e9-6c2667de39f0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:52.198854 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1abc871-02c1-4354-a9e9-6c2667de39f0 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:52.229291 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 238/475] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jul 13 23:34:52 2022] POST /identity/v3/users => generated 249 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 23:34:53.789612 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dcd1bb-253c-4201-a6eb-0b0813607937 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:53.790116 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dcd1bb-253c-4201-a6eb-0b0813607937 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:53.790190 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dcd1bb-253c-4201-a6eb-0b0813607937 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:53.791827 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 238/476] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:53.797690 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb70dab-a14c-41a1-a255-f86ba0874700 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:53.798106 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb70dab-a14c-41a1-a255-f86ba0874700 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:53.798277 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb70dab-a14c-41a1-a255-f86ba0874700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:53.815464 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-eeb70dab-a14c-41a1-a255-f86ba0874700 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:53.816982 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-eeb70dab-a14c-41a1-a255-f86ba0874700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:53.889675 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 239/477] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:34:53.914094 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dcd1bb-253c-4201-a6eb-0b0813607937 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:53.945901 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:54.033093 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dcd1bb-253c-4201-a6eb-0b0813607937 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:54.068715 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af5f7b-8740-48a3-87f4-8b73d3159547 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:54.069035 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af5f7b-8740-48a3-87f4-8b73d3159547 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:54.069370 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af5f7b-8740-48a3-87f4-8b73d3159547 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:54.069740 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f544e9-7631-49cd-9fb6-e7dc52d54672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:54.070534 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f544e9-7631-49cd-9fb6-e7dc52d54672 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:54.070819 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f544e9-7631-49cd-9fb6-e7dc52d54672 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:54.071094 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f544e9-7631-49cd-9fb6-e7dc52d54672 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:54.073020 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 240/478] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:54.076536 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bccea-4b74-4945-a72a-318264ddac3d None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:54.076834 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bccea-4b74-4945-a72a-318264ddac3d None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:54.077110 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bccea-4b74-4945-a72a-318264ddac3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:54.084174 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f544e9-7631-49cd-9fb6-e7dc52d54672 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:34:54.092749 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-53f544e9-7631-49cd-9fb6-e7dc52d54672 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 23:34:54.092749 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:54.092749 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:54.092749 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:54.092749 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:54.092749 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:54.092749 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:54.092749 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:54.092749 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:54.092749 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:54.092749 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:54.092749 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:54.092749 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:34:54.092749 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:34:54.092749 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:34:54.092749 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:34:54.093655 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:34:54.093655 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:34:54.093655 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:34:54.093655 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:34:54.093655 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:54.093655 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:54.093655 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:54.093655 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:54.093655 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:54.093655 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:54.093655 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:54.093655 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:54.093655 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:54.093655 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:54.093655 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:54.093655 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:54.094485 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:54.094485 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:54.094485 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:54.094485 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:54.094485 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:34:54.094485 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:34:54.094485 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:34:54.094485 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:34:54.094485 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:34:54.094485 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:34:54.094485 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 23:34:54.094485 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:34:54.094485 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 239/479] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jul 13 23:34:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:54.096153 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-995bccea-4b74-4945-a72a-318264ddac3d None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:54.097362 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-995bccea-4b74-4945-a72a-318264ddac3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:54.099837 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f544e9-7631-49cd-9fb6-e7dc52d54672 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:54.171223 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 241/480] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:34:54.183670 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997bdcb-d747-4747-ae87-28e8d6de4e5c None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:54.183983 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997bdcb-d747-4747-ae87-28e8d6de4e5c None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:54.184349 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997bdcb-d747-4747-ae87-28e8d6de4e5c None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:54.186082 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 242/481] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:54.191223 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029e2c7-70d3-4e76-8cc6-17defb1698d4 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:54.191699 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029e2c7-70d3-4e76-8cc6-17defb1698d4 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:54.192250 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029e2c7-70d3-4e76-8cc6-17defb1698d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:54.201145 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:54.209438 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-0029e2c7-70d3-4e76-8cc6-17defb1698d4 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:54.210621 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-0029e2c7-70d3-4e76-8cc6-17defb1698d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:54.216264 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f544e9-7631-49cd-9fb6-e7dc52d54672 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:54.239283 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:54.252855 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11044a-4968-4643-941c-3b14966af22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:54.253521 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11044a-4968-4643-941c-3b14966af22f None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:54.253805 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11044a-4968-4643-941c-3b14966af22f None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:54.254081 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11044a-4968-4643-941c-3b14966af22f None admin] PATH_INFO: `/v3/roles` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:54.254818 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c11044a-4968-4643-941c-3b14966af22f None admin] RBAC: Adding query filter params (name=service) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:54.255321 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c11044a-4968-4643-941c-3b14966af22f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:54.256506 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c11044a-4968-4643-941c-3b14966af22f None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:54.269374 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 240/482] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jul 13 23:34:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:54.269374 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11044a-4968-4643-941c-3b14966af22f None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:54.290080 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 243/483] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 23:34:54.297725 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029e2c7-70d3-4e76-8cc6-17defb1698d4 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:54.380646 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11044a-4968-4643-941c-3b14966af22f None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:54.409586 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029e2c7-70d3-4e76-8cc6-17defb1698d4 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:54.418447 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76f0d8-738a-405f-a5fd-54616f9adffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:54.419276 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76f0d8-738a-405f-a5fd-54616f9adffd None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:54.419561 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76f0d8-738a-405f-a5fd-54616f9adffd None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:54.419839 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76f0d8-738a-405f-a5fd-54616f9adffd None admin] PATH_INFO: `/v3/roles/service` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:54.431925 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab76f0d8-738a-405f-a5fd-54616f9adffd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:34:54.441257 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-ab76f0d8-738a-405f-a5fd-54616f9adffd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 23:34:54.441257 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:54.441257 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:54.441257 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:54.441257 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:54.441257 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:54.441257 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:54.441257 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:54.441257 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:54.441257 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:54.441257 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:54.441257 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:54.441257 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:34:54.441257 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:34:54.441257 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:34:54.441257 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:34:54.442201 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:34:54.442201 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:34:54.442201 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:34:54.442201 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:34:54.442201 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:54.442201 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:54.442201 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:54.442201 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:54.442201 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:54.442201 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:54.442201 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:54.442201 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:54.442201 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:54.442201 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:54.442201 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:54.442201 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:54.442990 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:54.442990 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:54.442990 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:54.442990 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:54.442990 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:34:54.442990 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:34:54.442990 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:34:54.442990 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:34:54.442990 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:34:54.442990 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:34:54.442990 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 23:34:54.442990 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:34:54.447494 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 241/484] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jul 13 23:34:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:54.448329 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76f0d8-738a-405f-a5fd-54616f9adffd None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:54.452720 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3751f6-2ffe-4594-8ff4-46ea2960bcaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:54.453726 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3751f6-2ffe-4594-8ff4-46ea2960bcaf None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:54.454159 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3751f6-2ffe-4594-8ff4-46ea2960bcaf None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:54.454581 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3751f6-2ffe-4594-8ff4-46ea2960bcaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:54.461590 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:54.466922 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3751f6-2ffe-4594-8ff4-46ea2960bcaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:54.468406 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3751f6-2ffe-4594-8ff4-46ea2960bcaf None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:54.487446 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-6a3751f6-2ffe-4594-8ff4-46ea2960bcaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:34:54.487446 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:54.487446 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:54.487446 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:54.487446 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:54.487446 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:54.487446 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:54.487446 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:54.487446 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:54.487446 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:54.487446 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:54.487446 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:54.487446 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:34:54.487446 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:34:54.487446 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:34:54.488307 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:34:54.488307 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:54.488307 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:54.488307 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:54.488307 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:54.488307 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:54.488307 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:54.488307 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:54.488307 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:54.488307 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:54.488307 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:54.488307 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:54.488307 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:54.488307 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:54.488307 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:54.488307 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:54.488307 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:54.489559 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:34:54.489559 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:34:54.489559 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:34:54.489559 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:34:54.489559 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 244/485] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:34:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:54.489834 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3751f6-2ffe-4594-8ff4-46ea2960bcaf None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:54.508683 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:54.571088 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76f0d8-738a-405f-a5fd-54616f9adffd None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:54.602759 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3751f6-2ffe-4594-8ff4-46ea2960bcaf None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:54.605524 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc38cfd-afc4-4736-aa15-041fc373fb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:54.606326 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc38cfd-afc4-4736-aa15-041fc373fb75 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:54.606609 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc38cfd-afc4-4736-aa15-041fc373fb75 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:54.606886 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc38cfd-afc4-4736-aa15-041fc373fb75 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:54.616941 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc38cfd-afc4-4736-aa15-041fc373fb75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:34:54.625280 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-3cc38cfd-afc4-4736-aa15-041fc373fb75 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 23:34:54.625280 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:54.625280 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:54.625280 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:54.625280 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:54.625280 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:54.625280 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:54.625280 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:54.625280 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:54.625280 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:54.625280 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:54.625280 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:54.625280 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:34:54.625280 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:34:54.625280 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:34:54.625280 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:34:54.626148 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:34:54.626148 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:34:54.626148 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:34:54.626148 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:34:54.626148 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:54.626148 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:54.626148 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:54.626148 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:54.626148 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:54.626148 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:54.626148 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:54.626148 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:54.626148 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:54.626148 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:54.626148 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:54.626148 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:54.626918 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:54.626918 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:54.626918 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:54.626918 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:54.626918 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:34:54.626918 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:34:54.626918 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:34:54.626918 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:34:54.626918 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:34:54.626918 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:34:54.626918 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 23:34:54.626918 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:34:54.626918 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 242/486] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jul 13 23:34:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:54.627577 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc38cfd-afc4-4736-aa15-041fc373fb75 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:54.642514 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ed90b-45e6-4ef2-a7d7-5a0d5d0103fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:54.643178 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ed90b-45e6-4ef2-a7d7-5a0d5d0103fc None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:54.643460 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ed90b-45e6-4ef2-a7d7-5a0d5d0103fc None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:54.643737 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ed90b-45e6-4ef2-a7d7-5a0d5d0103fc None admin] PATH_INFO: `/v3/roles` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:54.644472 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ed90b-45e6-4ef2-a7d7-5a0d5d0103fc None admin] RBAC: Adding query filter params (name=service) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:54.644774 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ed90b-45e6-4ef2-a7d7-5a0d5d0103fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:54.646240 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ed90b-45e6-4ef2-a7d7-5a0d5d0103fc None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:54.654317 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 245/487] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jul 13 23:34:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:54.655351 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9264c48-dbd0-46a8-b176-a1ce183f1eb3 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:54.655634 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9264c48-dbd0-46a8-b176-a1ce183f1eb3 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:54.655963 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9264c48-dbd0-46a8-b176-a1ce183f1eb3 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:54.657202 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 246/488] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:54.657948 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9264c48-dbd0-46a8-b176-a1ce183f1eb3 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:54.705334 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:54.736762 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc38cfd-afc4-4736-aa15-041fc373fb75 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:54.737354 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:54.760132 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9264c48-dbd0-46a8-b176-a1ce183f1eb3 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:54.770964 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316e7d7-dfd3-4fda-84ec-a36f895a0a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:54.771624 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316e7d7-dfd3-4fda-84ec-a36f895a0a53 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:54.771911 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316e7d7-dfd3-4fda-84ec-a36f895a0a53 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:54.772198 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316e7d7-dfd3-4fda-84ec-a36f895a0a53 None admin] PATH_INFO: `/v3/domains` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:54.772945 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2316e7d7-dfd3-4fda-84ec-a36f895a0a53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:54.773255 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2316e7d7-dfd3-4fda-84ec-a36f895a0a53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:54.774631 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2316e7d7-dfd3-4fda-84ec-a36f895a0a53 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:54.786033 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 243/489] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:34:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:54.786819 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316e7d7-dfd3-4fda-84ec-a36f895a0a53 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:54.794461 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f262e61-2cef-4413-aec1-cb7ce7bcff14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:54.795119 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f262e61-2cef-4413-aec1-cb7ce7bcff14 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:54.795403 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f262e61-2cef-4413-aec1-cb7ce7bcff14 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:54.795680 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f262e61-2cef-4413-aec1-cb7ce7bcff14 None admin] PATH_INFO: `/v3/roles` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:54.796420 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f262e61-2cef-4413-aec1-cb7ce7bcff14 None admin] RBAC: Adding query filter params (name=service) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:54.796726 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f262e61-2cef-4413-aec1-cb7ce7bcff14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:54.798176 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f262e61-2cef-4413-aec1-cb7ce7bcff14 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:54.806104 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 247/490] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jul 13 23:34:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:54.807269 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f7094-4678-4a11-8047-78869e3f8786 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:54.807561 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f7094-4678-4a11-8047-78869e3f8786 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:54.807837 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f7094-4678-4a11-8047-78869e3f8786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:54.825154 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-9e4f7094-4678-4a11-8047-78869e3f8786 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:34:54.826374 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-9e4f7094-4678-4a11-8047-78869e3f8786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:34:54.885369 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316e7d7-dfd3-4fda-84ec-a36f895a0a53 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:54.891844 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 248/491] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:34:54.892723 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f7094-4678-4a11-8047-78869e3f8786 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:54.919144 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:54.925621 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b32f7-7a86-4a3e-9728-bfc3d9119b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:54.926406 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b32f7-7a86-4a3e-9728-bfc3d9119b2b None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:54.926688 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b32f7-7a86-4a3e-9728-bfc3d9119b2b None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:54.926970 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b32f7-7a86-4a3e-9728-bfc3d9119b2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:54.937489 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b32f7-7a86-4a3e-9728-bfc3d9119b2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:54.938935 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b32f7-7a86-4a3e-9728-bfc3d9119b2b None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:54.956649 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-526b32f7-7a86-4a3e-9728-bfc3d9119b2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:34:54.956649 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:54.956649 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:54.956649 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:54.956649 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:54.956649 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:54.956649 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:54.956649 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:54.956649 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:54.956649 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:54.956649 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:54.956649 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:54.956649 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:34:54.956649 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:34:54.956649 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:34:54.957522 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:34:54.957522 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:54.957522 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:54.957522 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:54.957522 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:54.957522 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:54.957522 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:54.957522 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:54.957522 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:54.957522 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:54.957522 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:54.957522 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:54.957522 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:54.957522 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:54.957522 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:54.957522 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:54.957522 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:54.963325 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:34:54.963325 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:34:54.963325 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:34:54.963325 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:34:54.963325 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 244/492] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:34:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:54.963325 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b32f7-7a86-4a3e-9728-bfc3d9119b2b None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:54.963635 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:54.992715 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f7094-4678-4a11-8047-78869e3f8786 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:55.027194 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6e163-4e1f-4ee7-9a82-22671cc37e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:55.027977 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6e163-4e1f-4ee7-9a82-22671cc37e4e None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:55.028255 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6e163-4e1f-4ee7-9a82-22671cc37e4e None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:55.028526 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6e163-4e1f-4ee7-9a82-22671cc37e4e None admin] PATH_INFO: `/v3/users/nova` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:55.035361 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6e163-4e1f-4ee7-9a82-22671cc37e4e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:55.036790 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6e163-4e1f-4ee7-9a82-22671cc37e4e None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:55.052320 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-fea6e163-4e1f-4ee7-9a82-22671cc37e4e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 23:34:55.052320 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:55.052320 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:55.052320 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:55.052320 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:55.052320 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:55.052320 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:55.052320 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:55.052320 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:55.052320 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:55.052320 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:55.052320 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:55.052320 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 23:34:55.052320 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 23:34:55.052320 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 23:34:55.052320 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 23:34:55.053459 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:55.053459 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:55.053459 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 23:34:55.053459 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 23:34:55.053459 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 23:34:55.053459 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 23:34:55.053459 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:55.053459 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:55.053459 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:55.053459 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:55.053459 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:55.053459 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:55.053459 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:55.053459 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:55.053459 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:55.053459 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:55.053459 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:55.053459 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:55.054364 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:55.054364 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:55.054364 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 23:34:55.054364 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 23:34:55.054364 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 23:34:55.054364 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 23:34:55.054364 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 23:34:55.054364 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 23:34:55.054364 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 13 23:34:55.054364 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:34:55.054364 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 249/493] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jul 13 23:34:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:55.054364 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6e163-4e1f-4ee7-9a82-22671cc37e4e None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:55.059447 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b32f7-7a86-4a3e-9728-bfc3d9119b2b None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:55.093274 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb9d0f-a114-48c2-a2ce-2b0f2e24746b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:55.094060 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb9d0f-a114-48c2-a2ce-2b0f2e24746b None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:55.094344 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb9d0f-a114-48c2-a2ce-2b0f2e24746b None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:55.094616 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb9d0f-a114-48c2-a2ce-2b0f2e24746b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:55.104748 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb9d0f-a114-48c2-a2ce-2b0f2e24746b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:55.106334 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb9d0f-a114-48c2-a2ce-2b0f2e24746b None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:55.123948 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-63eb9d0f-a114-48c2-a2ce-2b0f2e24746b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:34:55.123948 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:55.123948 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:55.123948 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:55.123948 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:55.123948 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:55.123948 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:55.123948 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:55.123948 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:55.123948 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:55.123948 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:55.123948 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:55.123948 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:34:55.123948 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:34:55.123948 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:34:55.125060 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:34:55.125060 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:55.125060 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:55.125060 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:55.125060 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:55.125060 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:55.125060 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:55.125060 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:55.125060 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:55.125060 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:55.125060 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:55.125060 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:55.125060 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:55.125060 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:55.125060 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:55.125060 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:55.125060 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:55.126201 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:34:55.126201 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:34:55.126201 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:34:55.126201 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:34:55.126201 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 245/494] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:34:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:55.126201 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb9d0f-a114-48c2-a2ce-2b0f2e24746b None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:55.157949 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6e163-4e1f-4ee7-9a82-22671cc37e4e None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:55.161472 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:55.188378 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:55.194542 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c2a45-5bac-4214-9b3c-c607f7b73a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:55.195323 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c2a45-5bac-4214-9b3c-c607f7b73a0e None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:55.195604 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c2a45-5bac-4214-9b3c-c607f7b73a0e None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:55.195875 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c2a45-5bac-4214-9b3c-c607f7b73a0e None admin] PATH_INFO: `/v3/roles/service` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:55.205901 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26c2a45-5bac-4214-9b3c-c607f7b73a0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:34:55.213805 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-a26c2a45-5bac-4214-9b3c-c607f7b73a0e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 23:34:55.213805 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:55.213805 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:55.213805 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:55.213805 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:55.213805 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:55.213805 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:55.213805 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:55.213805 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:55.213805 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:55.213805 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:55.213805 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:55.213805 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:34:55.213805 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:34:55.213805 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:34:55.213805 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:34:55.215454 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:34:55.215454 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:34:55.215454 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:34:55.215454 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:34:55.215454 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:55.215454 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:55.215454 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:55.215454 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:55.215454 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:55.215454 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:55.215454 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:55.215454 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:55.215454 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:55.215454 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:55.215454 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:55.215454 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:55.216485 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:55.216485 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:55.216485 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:55.216485 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:55.216485 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:34:55.216485 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:34:55.216485 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:34:55.216485 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:34:55.216485 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:34:55.216485 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:34:55.216485 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 23:34:55.216485 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:34:55.216485 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 250/495] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jul 13 23:34:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:55.217487 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c2a45-5bac-4214-9b3c-c607f7b73a0e None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:55.230839 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb9d0f-a114-48c2-a2ce-2b0f2e24746b None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:55.265955 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0e9d9-2d0c-49e7-b93b-4236e857f7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:55.266688 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0e9d9-2d0c-49e7-b93b-4236e857f7dd None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:55.266982 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0e9d9-2d0c-49e7-b93b-4236e857f7dd None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:55.267256 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0e9d9-2d0c-49e7-b93b-4236e857f7dd None admin] PATH_INFO: `/v3/domains` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:55.267970 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0e9d9-2d0c-49e7-b93b-4236e857f7dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:55.268277 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0e9d9-2d0c-49e7-b93b-4236e857f7dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:55.269670 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0e9d9-2d0c-49e7-b93b-4236e857f7dd None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:55.281222 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 246/496] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:34:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:55.282196 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0e9d9-2d0c-49e7-b93b-4236e857f7dd None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:55.320441 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c2a45-5bac-4214-9b3c-c607f7b73a0e None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:55.354419 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479984d-15a0-40bb-88bc-3c81b58808ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:55.355677 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479984d-15a0-40bb-88bc-3c81b58808ba None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:55.356014 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479984d-15a0-40bb-88bc-3c81b58808ba None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:55.356350 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479984d-15a0-40bb-88bc-3c81b58808ba None admin] PATH_INFO: `/v3/users` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:55.357291 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0479984d-15a0-40bb-88bc-3c81b58808ba None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:55.357684 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0479984d-15a0-40bb-88bc-3c81b58808ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:55.359128 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0479984d-15a0-40bb-88bc-3c81b58808ba None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:55.375611 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:55.382227 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0e9d9-2d0c-49e7-b93b-4236e857f7dd None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:55.396530 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 251/497] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 13 23:34:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:55.397293 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479984d-15a0-40bb-88bc-3c81b58808ba None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:55.415503 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a5382-a05e-4c9d-8fca-cbcf07d66d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:55.416082 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a5382-a05e-4c9d-8fca-cbcf07d66d21 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:55.416368 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a5382-a05e-4c9d-8fca-cbcf07d66d21 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:55.416645 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a5382-a05e-4c9d-8fca-cbcf07d66d21 None admin] PATH_INFO: `/v3/domains` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:55.417954 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a5382-a05e-4c9d-8fca-cbcf07d66d21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:55.418494 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a5382-a05e-4c9d-8fca-cbcf07d66d21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:55.419872 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a5382-a05e-4c9d-8fca-cbcf07d66d21 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:55.432168 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 247/498] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:34:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:55.433743 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a5382-a05e-4c9d-8fca-cbcf07d66d21 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:55.446233 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:55.495579 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479984d-15a0-40bb-88bc-3c81b58808ba None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:55.529015 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d15cb-e5da-4d14-afe0-d752098170f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:55.529724 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d15cb-e5da-4d14-afe0-d752098170f3 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:55.530041 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d15cb-e5da-4d14-afe0-d752098170f3 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:55.530351 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d15cb-e5da-4d14-afe0-d752098170f3 None admin] PATH_INFO: `/v3/roles` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:55.531120 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d15cb-e5da-4d14-afe0-d752098170f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:55.531446 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d15cb-e5da-4d14-afe0-d752098170f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:55.532643 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a5382-a05e-4c9d-8fca-cbcf07d66d21 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:55.532845 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d15cb-e5da-4d14-afe0-d752098170f3 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:55.544012 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 252/499] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jul 13 23:34:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:55.544849 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d15cb-e5da-4d14-afe0-d752098170f3 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:55.568447 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fcf129-c68f-4209-ac9c-e6805304dd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:55.569265 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fcf129-c68f-4209-ac9c-e6805304dd9d None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:55.569553 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fcf129-c68f-4209-ac9c-e6805304dd9d None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:55.569832 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fcf129-c68f-4209-ac9c-e6805304dd9d None admin] PATH_INFO: `/v3/users/glance` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:55.577472 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fcf129-c68f-4209-ac9c-e6805304dd9d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:55.578912 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fcf129-c68f-4209-ac9c-e6805304dd9d None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:55.596136 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-03fcf129-c68f-4209-ac9c-e6805304dd9d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 13 23:34:55.596136 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:55.596136 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:55.596136 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:55.596136 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:55.596136 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:55.596136 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:55.596136 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:55.596136 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:55.596136 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:55.596136 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:55.596136 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:55.596136 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 23:34:55.596136 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 23:34:55.596136 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 23:34:55.596136 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 23:34:55.597273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:55.597273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:55.597273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 23:34:55.597273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 23:34:55.597273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 23:34:55.597273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 23:34:55.597273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:55.597273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:55.597273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:55.597273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:55.597273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:55.597273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:55.597273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:55.597273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:55.597273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:55.597273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:55.597273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:55.597273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:55.598371 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:55.598371 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:55.598371 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 23:34:55.598371 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 23:34:55.598371 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 23:34:55.598371 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 23:34:55.598371 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 23:34:55.598371 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 23:34:55.598371 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 13 23:34:55.598371 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:34:55.598371 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 248/500] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:34:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:55.598371 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fcf129-c68f-4209-ac9c-e6805304dd9d None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:55.617777 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:55.649066 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d15cb-e5da-4d14-afe0-d752098170f3 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:55.659715 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:55.684655 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918760af-26c9-4458-bd48-e78cfa08e5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:55.685257 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918760af-26c9-4458-bd48-e78cfa08e5f9 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:55.685538 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918760af-26c9-4458-bd48-e78cfa08e5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:55.685808 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918760af-26c9-4458-bd48-e78cfa08e5f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:55.703732 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fcf129-c68f-4209-ac9c-e6805304dd9d None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:55.737730 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a400cc-fe89-453a-971a-af51b9545a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:55.738534 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a400cc-fe89-453a-971a-af51b9545a1f None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:55.738815 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a400cc-fe89-453a-971a-af51b9545a1f None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:55.739095 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a400cc-fe89-453a-971a-af51b9545a1f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:55.747598 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a400cc-fe89-453a-971a-af51b9545a1f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:55.749067 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a400cc-fe89-453a-971a-af51b9545a1f None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:55.752392 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918760af-26c9-4458-bd48-e78cfa08e5f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:55.753869 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918760af-26c9-4458-bd48-e78cfa08e5f9 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:55.764155 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-13a400cc-fe89-453a-971a-af51b9545a1f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 13 23:34:55.764155 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:55.764155 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:55.764155 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:55.764155 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:55.764155 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:55.764155 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:55.764155 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:55.764155 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:55.764155 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:55.764155 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:55.764155 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:55.764155 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 23:34:55.764155 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 23:34:55.764155 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 23:34:55.764155 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 23:34:55.765113 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:55.765113 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:55.765113 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 23:34:55.765113 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 23:34:55.765113 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 23:34:55.765113 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 23:34:55.765113 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:55.765113 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:55.765113 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:55.765113 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:55.765113 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:55.765113 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:55.765113 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:55.765113 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:55.765113 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:55.765113 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:55.765113 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:55.765113 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:55.765990 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:55.765990 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:55.765990 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 23:34:55.765990 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 23:34:55.765990 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 23:34:55.765990 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 23:34:55.765990 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 23:34:55.765990 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 23:34:55.765990 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 13 23:34:55.765990 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:34:55.765990 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 249/501] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:34:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:55.766540 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a400cc-fe89-453a-971a-af51b9545a1f None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:55.849805 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:55.853373 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 253/502] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 13 23:34:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 23:34:55.854210 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918760af-26c9-4458-bd48-e78cfa08e5f9 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:55.867646 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:55.875791 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a400cc-fe89-453a-971a-af51b9545a1f None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:55.909747 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5c051-230c-441b-8227-ec1fde1b92bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:55.910528 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5c051-230c-441b-8227-ec1fde1b92bc None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:55.910809 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5c051-230c-441b-8227-ec1fde1b92bc None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:55.911082 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5c051-230c-441b-8227-ec1fde1b92bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:55.922480 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5c051-230c-441b-8227-ec1fde1b92bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:55.924072 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5c051-230c-441b-8227-ec1fde1b92bc None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:55.941226 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-46b5c051-230c-441b-8227-ec1fde1b92bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:34:55.941226 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:55.941226 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:55.941226 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:55.941226 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:55.941226 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:55.941226 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:55.941226 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:55.941226 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:55.941226 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:55.941226 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:55.941226 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:55.941226 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:34:55.941226 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:34:55.941226 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:34:55.942087 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:34:55.942087 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:55.942087 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:55.942087 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:55.942087 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:55.942087 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:55.942087 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:55.942087 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:55.942087 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:55.942087 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:55.942087 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:55.942087 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:55.942087 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:55.942087 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:55.942087 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:55.942087 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:55.942087 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:55.942923 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:34:55.942923 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:34:55.942923 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:34:55.942923 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:34:55.942923 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 250/503] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:34:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:55.943189 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5c051-230c-441b-8227-ec1fde1b92bc None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:55.956494 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918760af-26c9-4458-bd48-e78cfa08e5f9 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:55.990187 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57aeaf-513c-4082-897e-b9313109f800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:55.990876 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57aeaf-513c-4082-897e-b9313109f800 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:55.991157 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57aeaf-513c-4082-897e-b9313109f800 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:55.991431 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57aeaf-513c-4082-897e-b9313109f800 None admin] PATH_INFO: `/v3/users` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:55.992247 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57aeaf-513c-4082-897e-b9313109f800 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:55.992552 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57aeaf-513c-4082-897e-b9313109f800 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:55.994001 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57aeaf-513c-4082-897e-b9313109f800 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:56.010881 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 254/504] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Jul 13 23:34:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:56.012331 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57aeaf-513c-4082-897e-b9313109f800 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:56.046389 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5c051-230c-441b-8227-ec1fde1b92bc None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:56.072312 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:56.081516 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:56.081647 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40050ce8-0669-4f75-8843-361653cf754d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:56.082229 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40050ce8-0669-4f75-8843-361653cf754d None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:56.082519 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40050ce8-0669-4f75-8843-361653cf754d None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:56.082827 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40050ce8-0669-4f75-8843-361653cf754d None admin] PATH_INFO: `/v3/users` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:56.083710 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40050ce8-0669-4f75-8843-361653cf754d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:56.084019 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40050ce8-0669-4f75-8843-361653cf754d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:56.085564 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40050ce8-0669-4f75-8843-361653cf754d None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:56.114919 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57aeaf-513c-4082-897e-b9313109f800 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:56.121646 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 251/505] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Jul 13 23:34:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:56.122467 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40050ce8-0669-4f75-8843-361653cf754d None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:56.154352 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f911c6-7d42-4999-b052-ba6a07b83548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:56.155140 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f911c6-7d42-4999-b052-ba6a07b83548 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:56.155455 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f911c6-7d42-4999-b052-ba6a07b83548 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:56.155697 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f911c6-7d42-4999-b052-ba6a07b83548 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:56.165445 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f911c6-7d42-4999-b052-ba6a07b83548 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:56.167043 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f911c6-7d42-4999-b052-ba6a07b83548 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:56.185226 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-c0f911c6-7d42-4999-b052-ba6a07b83548 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:34:56.185226 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:56.185226 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:56.185226 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:56.185226 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:56.185226 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:56.185226 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:56.185226 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:56.185226 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:56.185226 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:56.185226 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:56.185226 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:56.185226 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:34:56.185226 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:34:56.185226 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:34:56.186262 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:34:56.186262 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:56.186262 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:56.186262 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:56.186262 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:56.186262 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:56.186262 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:56.186262 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:56.186262 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:56.186262 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:56.186262 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:56.186262 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:56.186262 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:56.186262 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:56.186262 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:56.186262 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:56.186262 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:56.187300 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:34:56.187300 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:34:56.187300 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:34:56.187300 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:34:56.191447 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 255/506] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:34:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:56.192097 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f911c6-7d42-4999-b052-ba6a07b83548 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:56.222055 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40050ce8-0669-4f75-8843-361653cf754d None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:56.255977 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b079dd9b-f57a-4086-87b6-32ae782df1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:56.256635 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079dd9b-f57a-4086-87b6-32ae782df1aa None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:56.256951 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079dd9b-f57a-4086-87b6-32ae782df1aa None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:56.257233 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079dd9b-f57a-4086-87b6-32ae782df1aa None admin] PATH_INFO: `/v3/domains` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:56.257946 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b079dd9b-f57a-4086-87b6-32ae782df1aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:56.258253 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b079dd9b-f57a-4086-87b6-32ae782df1aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:56.259636 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b079dd9b-f57a-4086-87b6-32ae782df1aa None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:56.271684 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 252/507] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:34:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:56.272481 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b079dd9b-f57a-4086-87b6-32ae782df1aa None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:56.292173 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f911c6-7d42-4999-b052-ba6a07b83548 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:56.311239 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:56.322363 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:56.327742 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37a593-e428-497b-b02c-003abaaed4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:56.328393 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37a593-e428-497b-b02c-003abaaed4af None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:56.328674 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37a593-e428-497b-b02c-003abaaed4af None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:56.328982 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37a593-e428-497b-b02c-003abaaed4af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:56.377159 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b079dd9b-f57a-4086-87b6-32ae782df1aa None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:56.395556 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab37a593-e428-497b-b02c-003abaaed4af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:56.397059 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab37a593-e428-497b-b02c-003abaaed4af None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:56.410117 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09346d97-c106-4c88-8a70-9c8355253ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:56.410757 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09346d97-c106-4c88-8a70-9c8355253ee9 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:56.411043 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09346d97-c106-4c88-8a70-9c8355253ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:56.411314 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09346d97-c106-4c88-8a70-9c8355253ee9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:56.477365 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09346d97-c106-4c88-8a70-9c8355253ee9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:56.478741 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09346d97-c106-4c88-8a70-9c8355253ee9 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:56.494574 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 256/508] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 13 23:34:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 23:34:56.499143 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37a593-e428-497b-b02c-003abaaed4af None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:56.517666 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:56.525665 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:56.583418 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 253/509] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 13 23:34:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 23:34:56.584264 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09346d97-c106-4c88-8a70-9c8355253ee9 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:56.598709 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37a593-e428-497b-b02c-003abaaed4af None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:56.631976 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbccf957-8620-43ef-9454-0aecb8a1ace5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:56.632627 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbccf957-8620-43ef-9454-0aecb8a1ace5 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:56.632937 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbccf957-8620-43ef-9454-0aecb8a1ace5 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:56.633210 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbccf957-8620-43ef-9454-0aecb8a1ace5 None admin] PATH_INFO: `/v3/domains` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:56.633922 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbccf957-8620-43ef-9454-0aecb8a1ace5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:56.634226 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbccf957-8620-43ef-9454-0aecb8a1ace5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:56.635595 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbccf957-8620-43ef-9454-0aecb8a1ace5 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:56.646791 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 257/510] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:34:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:56.647674 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbccf957-8620-43ef-9454-0aecb8a1ace5 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:56.681634 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09346d97-c106-4c88-8a70-9c8355253ee9 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:56.715590 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9198dd-88aa-48d3-a96c-084967a1a603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:56.716360 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9198dd-88aa-48d3-a96c-084967a1a603 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:56.716638 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9198dd-88aa-48d3-a96c-084967a1a603 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:56.716943 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9198dd-88aa-48d3-a96c-084967a1a603 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:56.723710 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9198dd-88aa-48d3-a96c-084967a1a603 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:56.725480 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9198dd-88aa-48d3-a96c-084967a1a603 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:56.731181 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:56.740407 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-4f9198dd-88aa-48d3-a96c-084967a1a603 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 13 23:34:56.740407 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:56.740407 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:56.740407 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:56.740407 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:56.740407 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:56.740407 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:56.740407 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:56.740407 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:56.740407 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:56.740407 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:56.740407 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:56.740407 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 23:34:56.740407 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 23:34:56.740407 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 23:34:56.740407 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 23:34:56.741572 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:56.741572 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:56.741572 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 23:34:56.741572 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 23:34:56.741572 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 23:34:56.741572 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 23:34:56.741572 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:56.741572 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:56.741572 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:56.741572 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:56.741572 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:56.741572 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:56.741572 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:56.741572 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:56.741572 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:56.741572 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:56.741572 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:56.741572 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:56.742454 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:56.742454 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:56.742454 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 23:34:56.742454 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 23:34:56.742454 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 23:34:56.742454 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 23:34:56.742454 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 23:34:56.742454 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 23:34:56.742454 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 13 23:34:56.742454 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:34:56.742454 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 254/511] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jul 13 23:34:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:56.742454 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9198dd-88aa-48d3-a96c-084967a1a603 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:56.746266 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:56.756356 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbccf957-8620-43ef-9454-0aecb8a1ace5 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:56.790576 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f72ad-dc53-4165-91b8-08ec08307cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:56.791366 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f72ad-dc53-4165-91b8-08ec08307cd0 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:56.791650 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f72ad-dc53-4165-91b8-08ec08307cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:56.791926 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f72ad-dc53-4165-91b8-08ec08307cd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:56.802478 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f72ad-dc53-4165-91b8-08ec08307cd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:56.803918 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f72ad-dc53-4165-91b8-08ec08307cd0 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:56.823329 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-913f72ad-dc53-4165-91b8-08ec08307cd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:34:56.823329 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:56.823329 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:56.823329 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:56.823329 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:56.823329 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:56.823329 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:56.823329 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:56.823329 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:56.823329 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:56.823329 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:56.823329 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:56.823329 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:34:56.823329 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:34:56.823329 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:34:56.825149 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:34:56.825149 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:56.825149 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:56.825149 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:56.825149 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:56.825149 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:56.825149 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:56.825149 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:56.825149 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:56.825149 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:56.825149 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:56.825149 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:56.825149 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:56.825149 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:56.825149 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:56.825149 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:56.825149 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:56.827144 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:34:56.827144 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:34:56.827144 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:34:56.827144 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:34:56.827144 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 258/512] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:34:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:56.827144 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f72ad-dc53-4165-91b8-08ec08307cd0 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:56.844371 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9198dd-88aa-48d3-a96c-084967a1a603 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:56.877487 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb857b-d27c-4890-a60a-5c8864645a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:56.878269 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb857b-d27c-4890-a60a-5c8864645a4b None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:56.878559 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb857b-d27c-4890-a60a-5c8864645a4b None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:56.878838 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb857b-d27c-4890-a60a-5c8864645a4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:56.889636 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fb857b-d27c-4890-a60a-5c8864645a4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:56.891091 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fb857b-d27c-4890-a60a-5c8864645a4b None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:56.908009 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-86fb857b-d27c-4890-a60a-5c8864645a4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:34:56.908009 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:56.908009 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:56.908009 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:56.908009 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:56.908009 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:56.908009 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:56.908009 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:56.908009 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:56.908009 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:56.908009 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:56.908009 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:56.908009 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:34:56.908009 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:34:56.908009 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:34:56.909105 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:34:56.909105 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:56.909105 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:56.909105 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:56.909105 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:56.909105 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:56.909105 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:56.909105 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:56.909105 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:56.909105 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:56.909105 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:56.909105 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:56.909105 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:56.909105 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:56.909105 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:56.909105 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:56.909105 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:56.910739 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:34:56.910739 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:34:56.910739 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:34:56.910739 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:34:56.910739 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 255/513] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:34:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:56.910739 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb857b-d27c-4890-a60a-5c8864645a4b None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:56.930522 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f72ad-dc53-4165-91b8-08ec08307cd0 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:56.959386 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:56.965160 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5508405-074a-4e2c-baa2-160b4dbf0111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:56.965957 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5508405-074a-4e2c-baa2-160b4dbf0111 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:56.966242 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5508405-074a-4e2c-baa2-160b4dbf0111 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:56.966527 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5508405-074a-4e2c-baa2-160b4dbf0111 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:56.966799 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:56.973751 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5508405-074a-4e2c-baa2-160b4dbf0111 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:56.975180 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5508405-074a-4e2c-baa2-160b4dbf0111 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:56.990539 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-f5508405-074a-4e2c-baa2-160b4dbf0111 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 23:34:56.990539 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:56.990539 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:56.990539 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:56.990539 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:56.990539 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:56.990539 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:56.990539 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:56.990539 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:56.990539 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:56.990539 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:56.990539 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:56.990539 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 23:34:56.990539 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 23:34:56.990539 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 23:34:56.991563 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 23:34:56.991563 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:56.991563 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:56.991563 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:56.991563 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:56.991563 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:56.991563 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:56.991563 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:56.991563 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:56.991563 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:56.991563 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:56.991563 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:56.991563 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:56.991563 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:56.991563 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:56.991563 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:56.991563 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:56.992423 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 23:34:56.992423 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 23:34:56.992423 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 23:34:56.992423 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 23:34:56.992423 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 23:34:56.992423 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 23:34:56.992423 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 23:34:56.992423 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:34:56.992423 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 259/514] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 13 23:34:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:56.992899 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5508405-074a-4e2c-baa2-160b4dbf0111 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:57.013368 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb857b-d27c-4890-a60a-5c8864645a4b None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:57.045797 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6e91b-6590-4a54-9315-464e0df7b09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:57.046452 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6e91b-6590-4a54-9315-464e0df7b09d None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:57.046732 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6e91b-6590-4a54-9315-464e0df7b09d None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:57.047007 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6e91b-6590-4a54-9315-464e0df7b09d None admin] PATH_INFO: `/v3/users` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:57.047825 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd6e91b-6590-4a54-9315-464e0df7b09d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:57.048133 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd6e91b-6590-4a54-9315-464e0df7b09d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:57.049592 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd6e91b-6590-4a54-9315-464e0df7b09d None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:57.066040 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 256/515] 10.222.0.16 () {56 vars in 1139 bytes} [Wed Jul 13 23:34:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:57.066829 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6e91b-6590-4a54-9315-464e0df7b09d None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:57.097006 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5508405-074a-4e2c-baa2-160b4dbf0111 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:57.129651 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8186dde1-9398-452f-9867-dcbe49602e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:57.130311 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186dde1-9398-452f-9867-dcbe49602e73 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:57.130591 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186dde1-9398-452f-9867-dcbe49602e73 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:57.130870 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186dde1-9398-452f-9867-dcbe49602e73 None admin] PATH_INFO: `/v3/domains` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:57.131571 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8186dde1-9398-452f-9867-dcbe49602e73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:57.131871 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8186dde1-9398-452f-9867-dcbe49602e73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:57.133279 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8186dde1-9398-452f-9867-dcbe49602e73 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:57.145166 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 260/516] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:34:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:57.145949 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8186dde1-9398-452f-9867-dcbe49602e73 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:57.167389 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6e91b-6590-4a54-9315-464e0df7b09d None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:57.183526 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:57.198791 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:57.205145 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe191f-7d4d-469b-954f-99d6bb335768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:57.205814 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe191f-7d4d-469b-954f-99d6bb335768 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:57.206105 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe191f-7d4d-469b-954f-99d6bb335768 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:57.206386 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe191f-7d4d-469b-954f-99d6bb335768 None admin] PATH_INFO: `/v3/domains` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:57.207113 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe191f-7d4d-469b-954f-99d6bb335768 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:57.207657 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe191f-7d4d-469b-954f-99d6bb335768 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:57.210265 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe191f-7d4d-469b-954f-99d6bb335768 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:57.223068 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 257/517] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:34:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:57.223900 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe191f-7d4d-469b-954f-99d6bb335768 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:57.251110 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8186dde1-9398-452f-9867-dcbe49602e73 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:57.284405 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1b0c9-6979-4da5-97be-769f91dbee3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:57.285092 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1b0c9-6979-4da5-97be-769f91dbee3a None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:57.285378 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1b0c9-6979-4da5-97be-769f91dbee3a None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:57.285652 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1b0c9-6979-4da5-97be-769f91dbee3a None admin] PATH_INFO: `/v3/projects` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:57.286429 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a1b0c9-6979-4da5-97be-769f91dbee3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:57.286738 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a1b0c9-6979-4da5-97be-769f91dbee3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:57.288162 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a1b0c9-6979-4da5-97be-769f91dbee3a None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:57.305380 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 261/518] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 13 23:34:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:57.306184 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1b0c9-6979-4da5-97be-769f91dbee3a None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:57.325171 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe191f-7d4d-469b-954f-99d6bb335768 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:57.359088 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f9413-bb60-44dd-9f1c-2e63c89cfe8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:57.359727 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f9413-bb60-44dd-9f1c-2e63c89cfe8d None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:57.360010 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f9413-bb60-44dd-9f1c-2e63c89cfe8d None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:57.360284 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f9413-bb60-44dd-9f1c-2e63c89cfe8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:57.402891 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:57.413775 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1b0c9-6979-4da5-97be-769f91dbee3a None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:57.426991 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:57.430525 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f9413-bb60-44dd-9f1c-2e63c89cfe8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:57.432314 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f9413-bb60-44dd-9f1c-2e63c89cfe8d None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:57.447910 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90242c3e-9c08-465f-8dea-a2791329c49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:57.449294 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90242c3e-9c08-465f-8dea-a2791329c49b None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:57.449576 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90242c3e-9c08-465f-8dea-a2791329c49b None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:57.449839 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90242c3e-9c08-465f-8dea-a2791329c49b None admin] PATH_INFO: `/v3/projects/service` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:57.456234 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90242c3e-9c08-465f-8dea-a2791329c49b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:57.457697 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90242c3e-9c08-465f-8dea-a2791329c49b None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:57.471617 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-90242c3e-9c08-465f-8dea-a2791329c49b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 23:34:57.471617 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:57.471617 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:57.471617 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:57.471617 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:57.471617 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:57.471617 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:57.471617 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:57.471617 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:57.471617 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:57.471617 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:57.471617 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:57.471617 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 23:34:57.471617 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 23:34:57.471617 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 23:34:57.472494 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 23:34:57.472494 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:57.472494 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:57.472494 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:57.472494 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:57.472494 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:57.472494 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:57.472494 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:57.472494 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:57.472494 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:57.472494 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:57.472494 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:57.472494 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:57.472494 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:57.472494 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:57.472494 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:57.472494 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:57.473367 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 23:34:57.473367 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 23:34:57.473367 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 23:34:57.473367 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 23:34:57.473367 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 23:34:57.473367 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 23:34:57.473367 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 23:34:57.473367 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:34:57.473367 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 262/519] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 13 23:34:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:57.473814 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90242c3e-9c08-465f-8dea-a2791329c49b None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:57.534092 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 258/520] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 13 23:34:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 23:34:57.534910 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f9413-bb60-44dd-9f1c-2e63c89cfe8d None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:57.576192 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90242c3e-9c08-465f-8dea-a2791329c49b None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:57.609618 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395f771-af16-40cf-be4f-e7e0c868ca38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:57.610402 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395f771-af16-40cf-be4f-e7e0c868ca38 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:57.610686 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395f771-af16-40cf-be4f-e7e0c868ca38 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:57.610963 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395f771-af16-40cf-be4f-e7e0c868ca38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:57.611730 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:57.618021 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b395f771-af16-40cf-be4f-e7e0c868ca38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:57.619487 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b395f771-af16-40cf-be4f-e7e0c868ca38 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:57.633878 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-b395f771-af16-40cf-be4f-e7e0c868ca38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 23:34:57.633878 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:57.633878 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:57.633878 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:57.633878 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:57.633878 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:57.633878 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:57.633878 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:57.633878 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:57.633878 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:57.633878 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:57.633878 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:57.633878 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 23:34:57.633878 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 23:34:57.633878 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 23:34:57.634930 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 23:34:57.634930 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:57.634930 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:57.634930 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:57.634930 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:57.634930 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:57.634930 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:57.634930 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:57.634930 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:57.634930 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:57.634930 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:57.634930 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:57.634930 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:57.634930 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:57.634930 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:57.634930 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:57.634930 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:57.636041 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 23:34:57.636041 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 23:34:57.636041 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 23:34:57.636041 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 23:34:57.636041 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 23:34:57.636041 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 23:34:57.636041 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 23:34:57.636041 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:34:57.636041 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 263/521] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 13 23:34:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:57.636041 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395f771-af16-40cf-be4f-e7e0c868ca38 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:57.642549 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f9413-bb60-44dd-9f1c-2e63c89cfe8d None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:57.666345 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:57.676461 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae87355-cfb9-4603-81a5-ccbb3675ab47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:57.677161 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae87355-cfb9-4603-81a5-ccbb3675ab47 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:57.677449 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae87355-cfb9-4603-81a5-ccbb3675ab47 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:57.677730 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae87355-cfb9-4603-81a5-ccbb3675ab47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:57.678553 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae87355-cfb9-4603-81a5-ccbb3675ab47 None admin] RBAC: Adding query filter params (role.id=3f7019b9af764b4089ae3cd30e8e2fb9, scope.project.id=11b8489ad08d40bc8f19a6ffa01c6897, user.id=a7e276c4bd434c028274e059a73c4060) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:57.678863 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae87355-cfb9-4603-81a5-ccbb3675ab47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:57.680291 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae87355-cfb9-4603-81a5-ccbb3675ab47 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:57.686384 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 259/522] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 13 23:34:57 2022] GET /identity/v3/role_assignments?user.id=a7e276c4bd434c028274e059a73c4060&scope.project.id=11b8489ad08d40bc8f19a6ffa01c6897&role.id=3f7019b9af764b4089ae3cd30e8e2fb9 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:57.687205 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae87355-cfb9-4603-81a5-ccbb3675ab47 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:57.743574 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395f771-af16-40cf-be4f-e7e0c868ca38 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:57.784916 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144617ce-4f8f-46f5-897b-c6de1f7d23fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:57.785520 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144617ce-4f8f-46f5-897b-c6de1f7d23fb None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:57.785803 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144617ce-4f8f-46f5-897b-c6de1f7d23fb None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:57.786078 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144617ce-4f8f-46f5-897b-c6de1f7d23fb None admin] PATH_INFO: `/v3/projects` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:57.786897 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144617ce-4f8f-46f5-897b-c6de1f7d23fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:57.787211 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144617ce-4f8f-46f5-897b-c6de1f7d23fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:57.788663 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144617ce-4f8f-46f5-897b-c6de1f7d23fb None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:57.806139 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae87355-cfb9-4603-81a5-ccbb3675ab47 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:57.808816 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 264/523] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 13 23:34:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:57.810020 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144617ce-4f8f-46f5-897b-c6de1f7d23fb None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:57.846545 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e36bd-aaed-4220-bd7f-d9e13acf609a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:57.847348 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e36bd-aaed-4220-bd7f-d9e13acf609a None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:57.847637 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e36bd-aaed-4220-bd7f-d9e13acf609a None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:57.847916 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e36bd-aaed-4220-bd7f-d9e13acf609a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:57.860143 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:57.865553 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e36bd-aaed-4220-bd7f-d9e13acf609a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:57.868134 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e36bd-aaed-4220-bd7f-d9e13acf609a None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:57.889024 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-7b2e36bd-aaed-4220-bd7f-d9e13acf609a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:34:57.889024 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:57.889024 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:57.889024 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:57.889024 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:57.889024 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:57.889024 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:57.889024 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:57.889024 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:57.889024 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:57.889024 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:57.889024 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:57.889024 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:34:57.889024 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:34:57.889024 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:34:57.889896 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:34:57.889896 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:57.889896 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:57.889896 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:57.889896 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:57.889896 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:57.889896 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:57.889896 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:57.889896 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:57.889896 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:57.889896 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:57.889896 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:57.889896 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:57.889896 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:57.889896 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:57.889896 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:57.889896 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:57.890858 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:34:57.890858 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:34:57.890858 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:34:57.890858 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:34:57.890858 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 260/524] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:34:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:57.891147 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e36bd-aaed-4220-bd7f-d9e13acf609a None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:57.930258 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:57.941073 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144617ce-4f8f-46f5-897b-c6de1f7d23fb None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:57.975500 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd7c6b-7143-40c0-bcb5-357853bf802f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:57.976156 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd7c6b-7143-40c0-bcb5-357853bf802f None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:57.976434 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd7c6b-7143-40c0-bcb5-357853bf802f None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:57.976703 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd7c6b-7143-40c0-bcb5-357853bf802f None admin] PATH_INFO: `/v3/projects` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:57.977508 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fd7c6b-7143-40c0-bcb5-357853bf802f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:57.977811 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fd7c6b-7143-40c0-bcb5-357853bf802f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:57.979257 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fd7c6b-7143-40c0-bcb5-357853bf802f None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:57.991247 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 265/525] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 13 23:34:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:57.992046 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd7c6b-7143-40c0-bcb5-357853bf802f None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:58.010437 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e36bd-aaed-4220-bd7f-d9e13acf609a None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:58.047037 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae53fb45-2685-406f-8966-556b423ba613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:58.047605 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53fb45-2685-406f-8966-556b423ba613 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:58.047895 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53fb45-2685-406f-8966-556b423ba613 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:58.048172 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53fb45-2685-406f-8966-556b423ba613 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:58.049031 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae53fb45-2685-406f-8966-556b423ba613 None admin] RBAC: Adding query filter params (role.id=3f7019b9af764b4089ae3cd30e8e2fb9, scope.project.id=11b8489ad08d40bc8f19a6ffa01c6897, user.id=15cdeb3131bc419f98ab11aaa4562d19) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:58.049348 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae53fb45-2685-406f-8966-556b423ba613 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:58.050783 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae53fb45-2685-406f-8966-556b423ba613 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:58.063761 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 261/526] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 13 23:34:57 2022] GET /identity/v3/role_assignments?user.id=15cdeb3131bc419f98ab11aaa4562d19&scope.project.id=11b8489ad08d40bc8f19a6ffa01c6897&role.id=3f7019b9af764b4089ae3cd30e8e2fb9 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:58.063761 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae53fb45-2685-406f-8966-556b423ba613 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:58.121193 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd7c6b-7143-40c0-bcb5-357853bf802f None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:58.128499 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:58.173374 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68afaa-e868-4ef4-802d-90e79ea8b8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:58.174314 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68afaa-e868-4ef4-802d-90e79ea8b8e1 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:58.174676 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68afaa-e868-4ef4-802d-90e79ea8b8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:58.175026 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68afaa-e868-4ef4-802d-90e79ea8b8e1 None admin] PATH_INFO: `/v3/domains` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:58.176469 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff68afaa-e868-4ef4-802d-90e79ea8b8e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:58.176786 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff68afaa-e868-4ef4-802d-90e79ea8b8e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:58.178421 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff68afaa-e868-4ef4-802d-90e79ea8b8e1 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:58.186052 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae53fb45-2685-406f-8966-556b423ba613 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:58.195934 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 266/527] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:34:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:58.202441 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68afaa-e868-4ef4-802d-90e79ea8b8e1 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:58.225770 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:58.236453 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe4ba3-2fac-4be0-b7ed-273e31843f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:58.237175 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe4ba3-2fac-4be0-b7ed-273e31843f39 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:58.237466 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe4ba3-2fac-4be0-b7ed-273e31843f39 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:58.237751 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe4ba3-2fac-4be0-b7ed-273e31843f39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:58.238594 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe4ba3-2fac-4be0-b7ed-273e31843f39 None admin] RBAC: Adding query filter params (role.id=3f7019b9af764b4089ae3cd30e8e2fb9, scope.project.id=11b8489ad08d40bc8f19a6ffa01c6897, user.id=ce654da79295477792be5ddb6e60ff12) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:58.238917 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe4ba3-2fac-4be0-b7ed-273e31843f39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:58.240399 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe4ba3-2fac-4be0-b7ed-273e31843f39 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:58.248356 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 262/528] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 13 23:34:58 2022] GET /identity/v3/role_assignments?user.id=ce654da79295477792be5ddb6e60ff12&scope.project.id=11b8489ad08d40bc8f19a6ffa01c6897&role.id=3f7019b9af764b4089ae3cd30e8e2fb9 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:58.348526 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68afaa-e868-4ef4-802d-90e79ea8b8e1 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:58.388423 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664928a-ff39-409e-8d7f-15badfd8ddda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:58.389547 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664928a-ff39-409e-8d7f-15badfd8ddda None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:58.389982 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664928a-ff39-409e-8d7f-15badfd8ddda None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:58.390421 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664928a-ff39-409e-8d7f-15badfd8ddda None admin] PATH_INFO: `/v3/projects/service` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:58.398573 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f664928a-ff39-409e-8d7f-15badfd8ddda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:58.400283 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f664928a-ff39-409e-8d7f-15badfd8ddda None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:58.416030 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-f664928a-ff39-409e-8d7f-15badfd8ddda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 23:34:58.416030 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:34:58.416030 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:34:58.416030 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:34:58.416030 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:34:58.416030 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:34:58.416030 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:34:58.416030 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:34:58.416030 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:34:58.416030 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:34:58.416030 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:34:58.416030 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:34:58.416030 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 23:34:58.416030 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 23:34:58.416030 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 23:34:58.417131 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 23:34:58.417131 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:34:58.417131 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:34:58.417131 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:34:58.417131 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:34:58.417131 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:34:58.417131 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:34:58.417131 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:34:58.417131 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:34:58.417131 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:34:58.417131 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:34:58.417131 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:34:58.417131 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:34:58.417131 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:34:58.417131 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:34:58.417131 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:34:58.417131 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:34:58.418488 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 23:34:58.418488 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 23:34:58.418488 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 23:34:58.418488 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 23:34:58.418488 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 23:34:58.418488 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 23:34:58.418488 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 23:34:58.418488 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:34:58.420689 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 267/529] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 13 23:34:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:34:58.426394 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe4ba3-2fac-4be0-b7ed-273e31843f39 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:58.544870 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe4ba3-2fac-4be0-b7ed-273e31843f39 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:58.561513 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:58.580373 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782941dd-f8c4-4bbe-944b-4201a6a924e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:58.581069 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782941dd-f8c4-4bbe-944b-4201a6a924e8 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:58.581360 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782941dd-f8c4-4bbe-944b-4201a6a924e8 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:58.581644 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782941dd-f8c4-4bbe-944b-4201a6a924e8 None admin] PATH_INFO: `/v3/projects` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:58.582686 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782941dd-f8c4-4bbe-944b-4201a6a924e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:58.583494 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782941dd-f8c4-4bbe-944b-4201a6a924e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:58.585038 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782941dd-f8c4-4bbe-944b-4201a6a924e8 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:58.603844 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 263/530] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 13 23:34:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:58.610616 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664928a-ff39-409e-8d7f-15badfd8ddda None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:34:58.689031 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:34:58.722136 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664928a-ff39-409e-8d7f-15badfd8ddda None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:34:58.758453 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d53873-ef33-428a-8be9-de0ddfc9556f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:34:58.759112 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d53873-ef33-428a-8be9-de0ddfc9556f None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:58.759444 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d53873-ef33-428a-8be9-de0ddfc9556f None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:58.759719 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d53873-ef33-428a-8be9-de0ddfc9556f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:58.760599 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d53873-ef33-428a-8be9-de0ddfc9556f None admin] RBAC: Adding query filter params (role.id=3f7019b9af764b4089ae3cd30e8e2fb9, scope.project.id=11b8489ad08d40bc8f19a6ffa01c6897, user.id=05f1ce71ea7c4301ae0bfc84a06c9c38) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:34:58.760998 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d53873-ef33-428a-8be9-de0ddfc9556f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:34:58.763323 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d53873-ef33-428a-8be9-de0ddfc9556f None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:34:58.769454 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 268/531] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 13 23:34:58 2022] GET /identity/v3/role_assignments?user.id=05f1ce71ea7c4301ae0bfc84a06c9c38&scope.project.id=11b8489ad08d40bc8f19a6ffa01c6897&role.id=3f7019b9af764b4089ae3cd30e8e2fb9 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:34:59.974915 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e8cff-4304-4043-b43c-c455f32b9b2f None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:59.975461 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e8cff-4304-4043-b43c-c455f32b9b2f None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:59.975461 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e8cff-4304-4043-b43c-c455f32b9b2f None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:34:59.977177 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 264/532] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:34:59.990724 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285b790-1e79-4fea-bcd2-e705b7097510 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:34:59.991188 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285b790-1e79-4fea-bcd2-e705b7097510 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:34:59.991289 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285b790-1e79-4fea-bcd2-e705b7097510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:00.013449 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-d285b790-1e79-4fea-bcd2-e705b7097510 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:35:00.014659 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-d285b790-1e79-4fea-bcd2-e705b7097510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:35:00.088484 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 269/533] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:34:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:35:00.112360 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e8cff-4304-4043-b43c-c455f32b9b2f None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:00.269339 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e8cff-4304-4043-b43c-c455f32b9b2f None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:00.327683 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80948d0-ba3b-4fe7-8d07-787b864ae0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:00.328536 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80948d0-ba3b-4fe7-8d07-787b864ae0bf None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:00.328847 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80948d0-ba3b-4fe7-8d07-787b864ae0bf None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:00.329154 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80948d0-ba3b-4fe7-8d07-787b864ae0bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:00.351595 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80948d0-ba3b-4fe7-8d07-787b864ae0bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:35:00.361307 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-d80948d0-ba3b-4fe7-8d07-787b864ae0bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 23:35:00.361307 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:00.361307 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:00.361307 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:00.361307 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:00.361307 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:00.361307 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:00.361307 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:00.361307 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:00.361307 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:00.361307 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:00.361307 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:00.361307 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:35:00.361307 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:35:00.361307 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:35:00.361307 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:35:00.362183 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:35:00.362183 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:35:00.362183 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:35:00.362183 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:35:00.362183 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:00.362183 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:00.362183 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:00.362183 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:00.362183 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:00.362183 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:00.362183 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:00.362183 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:00.362183 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:00.362183 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:00.362183 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:00.362183 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:00.362983 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:00.362983 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:00.362983 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:00.362983 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:00.362983 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:35:00.362983 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:35:00.362983 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:35:00.362983 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:35:00.362983 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:35:00.362983 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:35:00.362983 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 23:35:00.362983 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:00.362983 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 265/534] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jul 13 23:35:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:00.368692 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285b790-1e79-4fea-bcd2-e705b7097510 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:00.482300 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d959c-4ffe-4488-8faa-21d6c48e8204 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:00.482969 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d959c-4ffe-4488-8faa-21d6c48e8204 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:00.483461 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d959c-4ffe-4488-8faa-21d6c48e8204 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:00.489067 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 266/535] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:35:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:35:00.490541 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6132358-3df3-4c5b-b7fb-d9f542957c72 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:00.491069 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6132358-3df3-4c5b-b7fb-d9f542957c72 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:00.491553 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6132358-3df3-4c5b-b7fb-d9f542957c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:00.509875 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:00.518232 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-c6132358-3df3-4c5b-b7fb-d9f542957c72 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:35:00.528274 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-c6132358-3df3-4c5b-b7fb-d9f542957c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:35:00.581363 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285b790-1e79-4fea-bcd2-e705b7097510 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:00.582567 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:00.623581 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e671f7-6e46-47f7-8037-595864b10b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:00.624247 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e671f7-6e46-47f7-8037-595864b10b95 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:00.624533 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e671f7-6e46-47f7-8037-595864b10b95 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:00.624810 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e671f7-6e46-47f7-8037-595864b10b95 None admin] PATH_INFO: `/v3/roles` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:00.632842 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e671f7-6e46-47f7-8037-595864b10b95 None admin] RBAC: Adding query filter params (name=service) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:00.632842 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e671f7-6e46-47f7-8037-595864b10b95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:00.632842 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e671f7-6e46-47f7-8037-595864b10b95 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:00.633503 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 267/536] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:35:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:35:00.641747 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 270/537] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jul 13 23:35:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:00.642783 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6132358-3df3-4c5b-b7fb-d9f542957c72 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:00.654457 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e671f7-6e46-47f7-8037-595864b10b95 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:00.756918 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6132358-3df3-4c5b-b7fb-d9f542957c72 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:00.759860 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e671f7-6e46-47f7-8037-595864b10b95 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:00.787466 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:00.796175 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c63c4-aad4-4e17-bbc8-08ff7c2fbe10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:00.796417 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56175d9a-0b5d-4179-9f49-af5fd2e02188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:00.797005 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c63c4-aad4-4e17-bbc8-08ff7c2fbe10 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:00.797193 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56175d9a-0b5d-4179-9f49-af5fd2e02188 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:00.797297 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c63c4-aad4-4e17-bbc8-08ff7c2fbe10 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:00.797464 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56175d9a-0b5d-4179-9f49-af5fd2e02188 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:00.797553 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c63c4-aad4-4e17-bbc8-08ff7c2fbe10 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:00.797746 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56175d9a-0b5d-4179-9f49-af5fd2e02188 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:00.808175 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c63c4-aad4-4e17-bbc8-08ff7c2fbe10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:35:00.808475 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56175d9a-0b5d-4179-9f49-af5fd2e02188 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:00.809995 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56175d9a-0b5d-4179-9f49-af5fd2e02188 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:00.815993 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-102c63c4-aad4-4e17-bbc8-08ff7c2fbe10 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 23:35:00.815993 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:00.815993 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:00.815993 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:00.815993 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:00.815993 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:00.815993 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:00.815993 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:00.815993 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:00.815993 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:00.815993 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:00.815993 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:00.815993 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:35:00.815993 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:35:00.815993 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:35:00.815993 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:35:00.816893 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:35:00.816893 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:35:00.816893 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:35:00.816893 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:35:00.816893 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:00.816893 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:00.816893 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:00.816893 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:00.816893 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:00.816893 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:00.816893 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:00.816893 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:00.816893 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:00.816893 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:00.816893 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:00.816893 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:00.817722 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:00.817722 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:00.817722 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:00.817722 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:00.817722 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:35:00.817722 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:35:00.817722 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:35:00.817722 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:35:00.817722 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:35:00.817722 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:35:00.817722 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 23:35:00.817722 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:00.817722 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 271/538] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jul 13 23:35:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 23:35:00.818938 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff4e02-dfda-4e8a-8f8e-f67bd1f8d691 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:00.819044 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff4e02-dfda-4e8a-8f8e-f67bd1f8d691 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:00.819563 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff4e02-dfda-4e8a-8f8e-f67bd1f8d691 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:00.820701 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 272/539] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:35:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:35:00.825939 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff4e02-dfda-4e8a-8f8e-f67bd1f8d691 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:00.834367 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-56175d9a-0b5d-4179-9f49-af5fd2e02188 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:35:00.834367 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:00.834367 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:00.834367 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:00.834367 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:00.834367 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:00.834367 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:00.834367 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:00.834367 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:00.834367 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:00.834367 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:00.834367 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:00.834367 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:35:00.834367 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:35:00.834367 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:35:00.835229 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:35:00.835229 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:00.835229 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:00.835229 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:00.835229 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:00.835229 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:00.835229 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:00.835229 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:00.835229 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:00.835229 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:00.835229 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:00.835229 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:00.835229 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:00.835229 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:00.835229 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:00.835229 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:00.835229 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:00.836081 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:35:00.836081 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:35:00.836081 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:35:00.836081 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:00.836081 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 268/540] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:35:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 23:35:00.837235 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ee14a-e348-4bac-a019-c1ce9faf028b None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:00.837529 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ee14a-e348-4bac-a019-c1ce9faf028b None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:00.837831 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ee14a-e348-4bac-a019-c1ce9faf028b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:00.856538 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-e38ee14a-e348-4bac-a019-c1ce9faf028b None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:35:00.857785 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-e38ee14a-e348-4bac-a019-c1ce9faf028b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:35:00.872901 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:00.944848 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 269/541] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:35:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:35:00.944848 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ee14a-e348-4bac-a019-c1ce9faf028b None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:00.947000 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff4e02-dfda-4e8a-8f8e-f67bd1f8d691 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:00.988868 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0bba65-c9d0-4f71-8a27-ef6b9ccd6bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:00.989546 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bba65-c9d0-4f71-8a27-ef6b9ccd6bd9 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:00.989836 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bba65-c9d0-4f71-8a27-ef6b9ccd6bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:00.990115 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bba65-c9d0-4f71-8a27-ef6b9ccd6bd9 None admin] PATH_INFO: `/v3/roles` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:00.990880 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0bba65-c9d0-4f71-8a27-ef6b9ccd6bd9 None admin] RBAC: Adding query filter params (name=service) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:00.991423 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0bba65-c9d0-4f71-8a27-ef6b9ccd6bd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:00.992604 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0bba65-c9d0-4f71-8a27-ef6b9ccd6bd9 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:01.001580 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 273/542] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jul 13 23:35:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:35:01.002441 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0bba65-c9d0-4f71-8a27-ef6b9ccd6bd9 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:01.051316 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ee14a-e348-4bac-a019-c1ce9faf028b None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:01.060207 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:01.089018 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c660a-9b62-460d-adf1-0ef013a62a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:01.089821 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c660a-9b62-460d-adf1-0ef013a62a40 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:01.090118 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c660a-9b62-460d-adf1-0ef013a62a40 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:01.090396 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c660a-9b62-460d-adf1-0ef013a62a40 None admin] PATH_INFO: `/v3/domains` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:01.091119 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c660a-9b62-460d-adf1-0ef013a62a40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:01.091432 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c660a-9b62-460d-adf1-0ef013a62a40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:01.092804 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c660a-9b62-460d-adf1-0ef013a62a40 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:01.105806 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 270/543] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:35:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:01.107120 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c660a-9b62-460d-adf1-0ef013a62a40 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:01.114785 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0bba65-c9d0-4f71-8a27-ef6b9ccd6bd9 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:01.123103 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:01.151608 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55dd20e-c13f-4f7d-8404-fcf0212de318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:01.152395 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55dd20e-c13f-4f7d-8404-fcf0212de318 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:01.152681 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55dd20e-c13f-4f7d-8404-fcf0212de318 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:01.152988 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55dd20e-c13f-4f7d-8404-fcf0212de318 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:01.164069 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55dd20e-c13f-4f7d-8404-fcf0212de318 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:35:01.172550 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-c55dd20e-c13f-4f7d-8404-fcf0212de318 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 23:35:01.172550 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:01.172550 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:01.172550 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:01.172550 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:01.172550 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:01.172550 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:01.172550 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:01.172550 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:01.172550 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:01.172550 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:01.172550 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:01.172550 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:35:01.172550 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:35:01.172550 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:35:01.172550 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:35:01.173711 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:35:01.173711 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:35:01.173711 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:35:01.173711 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:35:01.173711 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:01.173711 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:01.173711 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:01.173711 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:01.173711 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:01.173711 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:01.173711 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:01.173711 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:01.173711 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:01.173711 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:01.173711 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:01.173711 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:01.174485 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:01.174485 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:01.174485 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:01.174485 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:01.174485 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:35:01.174485 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:35:01.174485 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:35:01.174485 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:35:01.174485 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:35:01.174485 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:35:01.174485 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 23:35:01.174485 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:01.174485 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 274/544] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jul 13 23:35:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:01.175129 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55dd20e-c13f-4f7d-8404-fcf0212de318 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:01.214916 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c660a-9b62-460d-adf1-0ef013a62a40 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:01.248096 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c6c3f-9503-4c9a-b5c9-a95bee679e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:01.248914 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c6c3f-9503-4c9a-b5c9-a95bee679e4b None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:01.249203 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c6c3f-9503-4c9a-b5c9-a95bee679e4b None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:01.249480 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c6c3f-9503-4c9a-b5c9-a95bee679e4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:01.259864 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c6c3f-9503-4c9a-b5c9-a95bee679e4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:01.261530 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c6c3f-9503-4c9a-b5c9-a95bee679e4b None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:01.274912 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55dd20e-c13f-4f7d-8404-fcf0212de318 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:01.279831 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-fc3c6c3f-9503-4c9a-b5c9-a95bee679e4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:35:01.279831 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:01.279831 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:01.279831 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:01.279831 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:01.279831 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:01.279831 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:01.279831 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:01.279831 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:01.279831 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:01.279831 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:01.279831 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:01.279831 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:35:01.279831 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:35:01.279831 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:35:01.280868 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:35:01.280868 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:01.280868 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:01.280868 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:01.280868 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:01.280868 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:01.280868 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:01.280868 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:01.280868 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:01.280868 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:01.280868 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:01.280868 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:01.280868 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:01.280868 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:01.280868 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:01.280868 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:01.280868 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:01.286246 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:35:01.286246 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:35:01.286246 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:35:01.286246 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:01.286246 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 271/545] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:35:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:01.286246 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046d203-25e7-45c8-b516-1a01c49ea4de None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:01.286246 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046d203-25e7-45c8-b516-1a01c49ea4de None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:01.286246 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046d203-25e7-45c8-b516-1a01c49ea4de None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:01.286246 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 272/546] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:35:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:35:01.286734 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046d203-25e7-45c8-b516-1a01c49ea4de None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:01.291490 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:01.314678 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b44f1-c228-4533-84cd-16b557902d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:01.315396 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b44f1-c228-4533-84cd-16b557902d3f None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:01.315684 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b44f1-c228-4533-84cd-16b557902d3f None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:01.315966 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b44f1-c228-4533-84cd-16b557902d3f None admin] PATH_INFO: `/v3/users/nova` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:01.323835 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b44f1-c228-4533-84cd-16b557902d3f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:01.325392 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b44f1-c228-4533-84cd-16b557902d3f None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:01.339881 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-939b44f1-c228-4533-84cd-16b557902d3f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 23:35:01.339881 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:01.339881 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:01.339881 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:01.339881 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:01.339881 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:01.339881 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:01.339881 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:01.339881 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:01.339881 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:01.339881 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:01.339881 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:01.339881 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 23:35:01.339881 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 23:35:01.339881 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 23:35:01.339881 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 23:35:01.340801 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:01.340801 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:01.340801 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 23:35:01.340801 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 23:35:01.340801 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 23:35:01.340801 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 23:35:01.340801 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:01.340801 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:01.340801 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:01.340801 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:01.340801 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:01.340801 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:01.340801 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:01.340801 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:01.340801 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:01.340801 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:01.340801 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:01.340801 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:01.341738 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:01.341738 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:01.341738 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 23:35:01.341738 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 23:35:01.341738 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 23:35:01.341738 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 23:35:01.341738 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 23:35:01.341738 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 23:35:01.341738 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 13 23:35:01.341738 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:01.341738 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 275/547] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jul 13 23:35:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:01.342287 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b44f1-c228-4533-84cd-16b557902d3f None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:01.351034 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:01.389930 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046d203-25e7-45c8-b516-1a01c49ea4de None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:01.424925 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a96292-f2ad-4987-ad54-2fe5b8ef85cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:01.425578 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a96292-f2ad-4987-ad54-2fe5b8ef85cf None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:01.425860 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a96292-f2ad-4987-ad54-2fe5b8ef85cf None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:01.426135 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a96292-f2ad-4987-ad54-2fe5b8ef85cf None admin] PATH_INFO: `/v3/roles` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:01.426865 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a96292-f2ad-4987-ad54-2fe5b8ef85cf None admin] RBAC: Adding query filter params (name=service) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:01.427167 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a96292-f2ad-4987-ad54-2fe5b8ef85cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:01.428535 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a96292-f2ad-4987-ad54-2fe5b8ef85cf None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:01.436213 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 273/548] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jul 13 23:35:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:01.437398 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d92d45-498c-4d38-acf5-7d44be1f082a None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:01.437687 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d92d45-498c-4d38-acf5-7d44be1f082a None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:01.437967 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d92d45-498c-4d38-acf5-7d44be1f082a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:01.440423 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b44f1-c228-4533-84cd-16b557902d3f None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:01.454723 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-70d92d45-498c-4d38-acf5-7d44be1f082a None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:35:01.455910 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-70d92d45-498c-4d38-acf5-7d44be1f082a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:35:01.474656 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc224a78-e17a-409c-adb3-ca2eb6dbf6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:01.475321 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc224a78-e17a-409c-adb3-ca2eb6dbf6cd None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:01.475609 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc224a78-e17a-409c-adb3-ca2eb6dbf6cd None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:01.475887 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc224a78-e17a-409c-adb3-ca2eb6dbf6cd None admin] PATH_INFO: `/v3/domains` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:01.476611 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc224a78-e17a-409c-adb3-ca2eb6dbf6cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:01.477002 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc224a78-e17a-409c-adb3-ca2eb6dbf6cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:01.478304 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc224a78-e17a-409c-adb3-ca2eb6dbf6cd None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:01.490711 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 276/549] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:35:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:01.491499 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc224a78-e17a-409c-adb3-ca2eb6dbf6cd None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:01.524313 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:01.525972 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 274/550] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:35:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:35:01.526898 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d92d45-498c-4d38-acf5-7d44be1f082a None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:01.586389 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:01.603073 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc224a78-e17a-409c-adb3-ca2eb6dbf6cd None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:01.631988 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d92d45-498c-4d38-acf5-7d44be1f082a None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:01.640263 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea117a-cf58-46e9-86ad-d853ce9381fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:01.640978 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea117a-cf58-46e9-86ad-d853ce9381fc None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:01.641258 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea117a-cf58-46e9-86ad-d853ce9381fc None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:01.641531 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea117a-cf58-46e9-86ad-d853ce9381fc None admin] PATH_INFO: `/v3/users` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:01.642340 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea117a-cf58-46e9-86ad-d853ce9381fc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:01.642644 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea117a-cf58-46e9-86ad-d853ce9381fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:01.644045 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea117a-cf58-46e9-86ad-d853ce9381fc None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:01.660534 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 277/551] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 13 23:35:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:01.661443 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea117a-cf58-46e9-86ad-d853ce9381fc None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:01.665273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcade8ca-bf26-44c1-9832-dba5fbdb3a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:01.666061 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcade8ca-bf26-44c1-9832-dba5fbdb3a08 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:01.666347 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcade8ca-bf26-44c1-9832-dba5fbdb3a08 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:01.666629 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcade8ca-bf26-44c1-9832-dba5fbdb3a08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:01.678125 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcade8ca-bf26-44c1-9832-dba5fbdb3a08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:01.679565 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcade8ca-bf26-44c1-9832-dba5fbdb3a08 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:01.700790 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-bcade8ca-bf26-44c1-9832-dba5fbdb3a08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:35:01.700790 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:01.700790 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:01.700790 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:01.700790 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:01.700790 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:01.700790 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:01.700790 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:01.700790 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:01.700790 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:01.700790 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:01.700790 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:01.700790 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:35:01.700790 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:35:01.700790 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:35:01.701996 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:35:01.701996 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:01.701996 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:01.701996 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:01.701996 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:01.701996 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:01.701996 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:01.701996 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:01.701996 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:01.701996 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:01.701996 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:01.701996 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:01.701996 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:01.701996 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:01.701996 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:01.701996 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:01.701996 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:01.703488 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:35:01.703488 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:35:01.703488 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:35:01.703488 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:01.703488 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 275/552] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:35:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:01.703488 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcade8ca-bf26-44c1-9832-dba5fbdb3a08 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:01.754561 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:01.767380 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea117a-cf58-46e9-86ad-d853ce9381fc None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:01.802233 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b032bc-6ceb-4a90-8698-0f7fffb655b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:01.803018 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b032bc-6ceb-4a90-8698-0f7fffb655b3 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:01.803299 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b032bc-6ceb-4a90-8698-0f7fffb655b3 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:01.803570 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b032bc-6ceb-4a90-8698-0f7fffb655b3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:01.803694 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcade8ca-bf26-44c1-9832-dba5fbdb3a08 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:01.810546 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b032bc-6ceb-4a90-8698-0f7fffb655b3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:01.810699 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:01.812022 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b032bc-6ceb-4a90-8698-0f7fffb655b3 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:01.826257 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-26b032bc-6ceb-4a90-8698-0f7fffb655b3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 13 23:35:01.826257 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:01.826257 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:01.826257 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:01.826257 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:01.826257 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:01.826257 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:01.826257 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:01.826257 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:01.826257 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:01.826257 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:01.826257 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:01.826257 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 23:35:01.826257 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 23:35:01.826257 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 23:35:01.826257 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 23:35:01.827422 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:01.827422 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:01.827422 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 23:35:01.827422 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 23:35:01.827422 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 23:35:01.827422 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 23:35:01.827422 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:01.827422 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:01.827422 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:01.827422 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:01.827422 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:01.827422 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:01.827422 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:01.827422 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:01.827422 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:01.827422 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:01.827422 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:01.827422 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:01.828348 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:01.828348 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:01.828348 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 23:35:01.828348 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 23:35:01.828348 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 23:35:01.828348 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 23:35:01.828348 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 23:35:01.828348 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 23:35:01.828348 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 13 23:35:01.828348 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:01.828348 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 278/553] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:35:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:01.828978 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b032bc-6ceb-4a90-8698-0f7fffb655b3 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:01.843462 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cc0d3-5343-4f6e-b814-415f209eb75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:01.844188 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cc0d3-5343-4f6e-b814-415f209eb75c None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:01.844521 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cc0d3-5343-4f6e-b814-415f209eb75c None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:01.844799 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cc0d3-5343-4f6e-b814-415f209eb75c None admin] PATH_INFO: `/v3/roles/service` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:01.855399 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219cc0d3-5343-4f6e-b814-415f209eb75c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:35:01.863141 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-219cc0d3-5343-4f6e-b814-415f209eb75c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 23:35:01.863141 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:01.863141 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:01.863141 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:01.863141 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:01.863141 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:01.863141 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:01.863141 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:01.863141 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:01.863141 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:01.863141 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:01.863141 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:01.863141 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:35:01.863141 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:35:01.863141 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:35:01.863141 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:35:01.864376 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:35:01.864376 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:35:01.864376 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:35:01.864376 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:35:01.864376 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:01.864376 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:01.864376 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:01.864376 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:01.864376 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:01.864376 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:01.864376 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:01.864376 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:01.864376 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:01.864376 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:01.864376 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:01.864376 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:01.865379 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:01.865379 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:01.865379 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:01.865379 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:01.865379 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:35:01.865379 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:35:01.865379 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:35:01.865379 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:35:01.865379 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:35:01.865379 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:35:01.865379 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 23:35:01.865379 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:01.865379 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 276/554] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jul 13 23:35:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:01.865379 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cc0d3-5343-4f6e-b814-415f209eb75c None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:01.933522 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b032bc-6ceb-4a90-8698-0f7fffb655b3 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:01.963593 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cc0d3-5343-4f6e-b814-415f209eb75c None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:01.966689 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d0dff-5091-423b-aca5-d292bca854e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:01.967477 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d0dff-5091-423b-aca5-d292bca854e6 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:01.967758 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d0dff-5091-423b-aca5-d292bca854e6 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:01.968029 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d0dff-5091-423b-aca5-d292bca854e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:01.977925 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d0dff-5091-423b-aca5-d292bca854e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:01.979350 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d0dff-5091-423b-aca5-d292bca854e6 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:01.989044 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:01.999673 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-551d0dff-5091-423b-aca5-d292bca854e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:35:01.999673 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:01.999673 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:01.999673 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:01.999673 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:01.999673 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:01.999673 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:01.999673 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:01.999673 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:01.999673 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:01.999673 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:01.999673 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:01.999673 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:35:01.999673 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:35:01.999673 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:35:02.001330 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:35:02.001330 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:02.001330 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:02.001330 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:02.001330 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:02.001330 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:02.001330 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:02.001330 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:02.001330 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:02.001330 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:02.001330 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:02.001330 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:02.001330 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:02.001330 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:02.001330 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:02.001330 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:02.001330 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:02.002348 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:35:02.002348 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:35:02.002348 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:35:02.002348 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:02.002572 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83bc85d-ddd1-4406-bcf5-8e053592eb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:02.002572 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83bc85d-ddd1-4406-bcf5-8e053592eb92 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:02.002572 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83bc85d-ddd1-4406-bcf5-8e053592eb92 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:02.002572 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83bc85d-ddd1-4406-bcf5-8e053592eb92 None admin] PATH_INFO: `/v3/domains` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:02.002839 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83bc85d-ddd1-4406-bcf5-8e053592eb92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:02.002839 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83bc85d-ddd1-4406-bcf5-8e053592eb92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:02.002966 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 279/555] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:35:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:02.002966 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d0dff-5091-423b-aca5-d292bca854e6 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:02.003390 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83bc85d-ddd1-4406-bcf5-8e053592eb92 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:02.015583 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 277/556] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:35:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:02.016267 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83bc85d-ddd1-4406-bcf5-8e053592eb92 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:02.043070 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:02.111335 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d0dff-5091-423b-aca5-d292bca854e6 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:02.113424 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83bc85d-ddd1-4406-bcf5-8e053592eb92 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:02.145650 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3f307-9b89-4879-a430-3d351610787c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:02.146309 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3f307-9b89-4879-a430-3d351610787c None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:02.146592 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3f307-9b89-4879-a430-3d351610787c None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:02.146864 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3f307-9b89-4879-a430-3d351610787c None admin] PATH_INFO: `/v3/users` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:02.147759 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3f307-9b89-4879-a430-3d351610787c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:02.148013 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3f307-9b89-4879-a430-3d351610787c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:02.148356 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad3e4a-60e9-4366-b9de-d2bc26570a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:02.149055 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad3e4a-60e9-4366-b9de-d2bc26570a78 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:02.149349 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad3e4a-60e9-4366-b9de-d2bc26570a78 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:02.149444 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3f307-9b89-4879-a430-3d351610787c None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:02.149633 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad3e4a-60e9-4366-b9de-d2bc26570a78 None admin] PATH_INFO: `/v3/roles` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:02.150374 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad3e4a-60e9-4366-b9de-d2bc26570a78 None admin] RBAC: Adding query filter params (name=service) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:02.150686 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad3e4a-60e9-4366-b9de-d2bc26570a78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:02.152498 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad3e4a-60e9-4366-b9de-d2bc26570a78 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:02.160300 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 278/557] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jul 13 23:35:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:02.161120 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad3e4a-60e9-4366-b9de-d2bc26570a78 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:02.171376 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 280/558] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Jul 13 23:35:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:02.171376 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3f307-9b89-4879-a430-3d351610787c None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:02.226370 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:02.251779 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:02.265513 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad3e4a-60e9-4366-b9de-d2bc26570a78 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:02.269188 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3f307-9b89-4879-a430-3d351610787c None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:02.298151 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece8161-2a94-4d9e-b5b2-368c32cbd6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:02.298804 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece8161-2a94-4d9e-b5b2-368c32cbd6e8 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:02.299086 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece8161-2a94-4d9e-b5b2-368c32cbd6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:02.299364 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece8161-2a94-4d9e-b5b2-368c32cbd6e8 None admin] PATH_INFO: `/v3/domains` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:02.300075 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece8161-2a94-4d9e-b5b2-368c32cbd6e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:02.300383 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece8161-2a94-4d9e-b5b2-368c32cbd6e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:02.301775 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece8161-2a94-4d9e-b5b2-368c32cbd6e8 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:02.302679 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f8a1e-781e-4710-90ca-b733cd32a935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:02.303463 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f8a1e-781e-4710-90ca-b733cd32a935 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:02.303741 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f8a1e-781e-4710-90ca-b733cd32a935 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:02.304017 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f8a1e-781e-4710-90ca-b733cd32a935 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:02.311410 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0f8a1e-781e-4710-90ca-b733cd32a935 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:02.312887 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0f8a1e-781e-4710-90ca-b733cd32a935 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:02.313312 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 279/559] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:35:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:02.314008 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece8161-2a94-4d9e-b5b2-368c32cbd6e8 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:02.332100 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-9c0f8a1e-781e-4710-90ca-b733cd32a935 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 13 23:35:02.332100 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:02.332100 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:02.332100 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:02.332100 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:02.332100 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:02.332100 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:02.332100 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:02.332100 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:02.332100 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:02.332100 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:02.332100 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:02.332100 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 23:35:02.332100 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 23:35:02.332100 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 23:35:02.332100 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 23:35:02.333320 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:02.333320 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:02.333320 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 23:35:02.333320 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 23:35:02.333320 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 23:35:02.333320 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 23:35:02.333320 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:02.333320 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:02.333320 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:02.333320 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:02.333320 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:02.333320 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:02.333320 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:02.333320 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:02.333320 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:02.333320 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:02.333320 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:02.333320 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:02.334340 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:02.334340 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:02.334340 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 23:35:02.334340 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 23:35:02.334340 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 23:35:02.334340 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 23:35:02.334340 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 23:35:02.334340 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 23:35:02.334340 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 13 23:35:02.334340 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:02.334340 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 281/560] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:35:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:02.334940 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f8a1e-781e-4710-90ca-b733cd32a935 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:02.422145 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece8161-2a94-4d9e-b5b2-368c32cbd6e8 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:02.436573 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f8a1e-781e-4710-90ca-b733cd32a935 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:02.454362 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:02.455989 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2630358-2ffa-4473-86a2-4cf4ad5908b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:02.456777 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2630358-2ffa-4473-86a2-4cf4ad5908b7 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:02.457100 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2630358-2ffa-4473-86a2-4cf4ad5908b7 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:02.457380 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2630358-2ffa-4473-86a2-4cf4ad5908b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:02.468421 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2630358-2ffa-4473-86a2-4cf4ad5908b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:02.469888 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2630358-2ffa-4473-86a2-4cf4ad5908b7 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:02.472580 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47b081-ebf3-457f-bee8-69671627cec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:02.473389 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47b081-ebf3-457f-bee8-69671627cec2 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:02.473671 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47b081-ebf3-457f-bee8-69671627cec2 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:02.473943 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47b081-ebf3-457f-bee8-69671627cec2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:02.478184 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:02.484003 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb47b081-ebf3-457f-bee8-69671627cec2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:02.485473 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb47b081-ebf3-457f-bee8-69671627cec2 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:02.488625 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-f2630358-2ffa-4473-86a2-4cf4ad5908b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:35:02.488625 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:02.488625 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:02.488625 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:02.488625 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:02.488625 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:02.488625 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:02.488625 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:02.488625 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:02.488625 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:02.488625 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:02.488625 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:02.488625 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:35:02.488625 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:35:02.488625 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:35:02.489526 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:35:02.489526 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:02.489526 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:02.489526 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:02.489526 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:02.489526 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:02.489526 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:02.489526 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:02.489526 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:02.489526 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:02.489526 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:02.489526 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:02.489526 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:02.489526 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:02.489526 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:02.489526 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:02.489526 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:02.490419 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:35:02.490419 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:35:02.490419 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:35:02.490419 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:02.490419 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 280/561] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:35:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:02.490699 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2630358-2ffa-4473-86a2-4cf4ad5908b7 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:02.507692 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-eb47b081-ebf3-457f-bee8-69671627cec2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:35:02.507692 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:02.507692 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:02.507692 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:02.507692 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:02.507692 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:02.507692 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:02.507692 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:02.507692 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:02.507692 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:02.507692 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:02.507692 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:02.507692 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:35:02.507692 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:35:02.507692 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:35:02.508756 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:35:02.508756 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:02.508756 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:02.508756 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:02.508756 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:02.508756 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:02.508756 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:02.508756 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:02.508756 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:02.508756 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:02.508756 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:02.508756 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:02.508756 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:02.508756 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:02.508756 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:02.508756 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:02.508756 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:02.510177 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:35:02.510177 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:35:02.510177 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:35:02.510177 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:02.510177 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 282/562] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:35:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:02.510177 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47b081-ebf3-457f-bee8-69671627cec2 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:02.601269 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2630358-2ffa-4473-86a2-4cf4ad5908b7 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:02.613850 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47b081-ebf3-457f-bee8-69671627cec2 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:02.636467 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d35d8f0-198c-4f0a-b3ff-a208b95beb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:02.637301 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d35d8f0-198c-4f0a-b3ff-a208b95beb26 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:02.637831 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d35d8f0-198c-4f0a-b3ff-a208b95beb26 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:02.638108 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d35d8f0-198c-4f0a-b3ff-a208b95beb26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:02.644542 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d35d8f0-198c-4f0a-b3ff-a208b95beb26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:02.646002 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d35d8f0-198c-4f0a-b3ff-a208b95beb26 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:02.647944 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb48d8-5e70-40e4-9814-166a8056f606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:02.648600 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb48d8-5e70-40e4-9814-166a8056f606 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:02.648940 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb48d8-5e70-40e4-9814-166a8056f606 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:02.649212 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb48d8-5e70-40e4-9814-166a8056f606 None admin] PATH_INFO: `/v3/users` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:02.650028 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb48d8-5e70-40e4-9814-166a8056f606 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:02.650331 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb48d8-5e70-40e4-9814-166a8056f606 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:02.652366 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb48d8-5e70-40e4-9814-166a8056f606 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:02.660529 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-0d35d8f0-198c-4f0a-b3ff-a208b95beb26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 23:35:02.660529 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:02.660529 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:02.660529 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:02.660529 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:02.660529 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:02.660529 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:02.660529 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:02.660529 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:02.660529 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:02.660529 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:02.660529 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:02.660529 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 23:35:02.660529 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 23:35:02.660529 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 23:35:02.661533 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 23:35:02.661533 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:02.661533 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:02.661533 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:02.661533 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:02.661533 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:02.661533 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:02.661533 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:02.661533 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:02.661533 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:02.661533 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:02.661533 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:02.661533 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:02.661533 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:02.661533 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:02.661533 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:02.661533 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:02.662455 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 23:35:02.662455 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 23:35:02.662455 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 23:35:02.662455 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 23:35:02.662455 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 23:35:02.662455 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 23:35:02.662455 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 23:35:02.662455 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:02.662455 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 281/563] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 13 23:35:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:02.662455 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d35d8f0-198c-4f0a-b3ff-a208b95beb26 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:02.675376 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 283/564] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Jul 13 23:35:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:02.675376 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb48d8-5e70-40e4-9814-166a8056f606 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:02.700699 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:02.724836 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:02.765874 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d35d8f0-198c-4f0a-b3ff-a208b95beb26 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:02.771215 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb48d8-5e70-40e4-9814-166a8056f606 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:02.798156 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ebf6b-ff7f-43da-b4ed-8bb239f9c316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:02.798923 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ebf6b-ff7f-43da-b4ed-8bb239f9c316 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:02.799217 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ebf6b-ff7f-43da-b4ed-8bb239f9c316 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:02.799488 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ebf6b-ff7f-43da-b4ed-8bb239f9c316 None admin] PATH_INFO: `/v3/domains` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:02.800205 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990ebf6b-ff7f-43da-b4ed-8bb239f9c316 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:02.800516 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990ebf6b-ff7f-43da-b4ed-8bb239f9c316 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:02.801954 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990ebf6b-ff7f-43da-b4ed-8bb239f9c316 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:02.804447 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a35ad4-ea29-426f-bbdc-7e0f55436f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:02.805143 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a35ad4-ea29-426f-bbdc-7e0f55436f3d None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:02.805429 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a35ad4-ea29-426f-bbdc-7e0f55436f3d None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:02.805705 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a35ad4-ea29-426f-bbdc-7e0f55436f3d None admin] PATH_INFO: `/v3/domains` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:02.806414 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a35ad4-ea29-426f-bbdc-7e0f55436f3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:02.806720 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a35ad4-ea29-426f-bbdc-7e0f55436f3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:02.808606 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a35ad4-ea29-426f-bbdc-7e0f55436f3d None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:02.814122 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 282/565] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:35:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:02.815353 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ebf6b-ff7f-43da-b4ed-8bb239f9c316 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:02.819790 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 284/566] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:35:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:02.820584 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a35ad4-ea29-426f-bbdc-7e0f55436f3d None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:02.906603 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:02.915848 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ebf6b-ff7f-43da-b4ed-8bb239f9c316 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:02.918932 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a35ad4-ea29-426f-bbdc-7e0f55436f3d None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:02.936610 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:02.950949 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599afc2e-3d27-4665-8172-86fc6be435b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:02.951602 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599afc2e-3d27-4665-8172-86fc6be435b4 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:02.951885 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599afc2e-3d27-4665-8172-86fc6be435b4 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:02.952157 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599afc2e-3d27-4665-8172-86fc6be435b4 None admin] PATH_INFO: `/v3/projects` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:02.952488 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c7978-66aa-4bf3-b87e-e194a921c464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:02.952959 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599afc2e-3d27-4665-8172-86fc6be435b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:02.953268 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599afc2e-3d27-4665-8172-86fc6be435b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:02.953367 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c7978-66aa-4bf3-b87e-e194a921c464 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:02.953568 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c7978-66aa-4bf3-b87e-e194a921c464 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:02.953842 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c7978-66aa-4bf3-b87e-e194a921c464 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:02.954694 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599afc2e-3d27-4665-8172-86fc6be435b4 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:02.964175 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2c7978-66aa-4bf3-b87e-e194a921c464 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:02.965618 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2c7978-66aa-4bf3-b87e-e194a921c464 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:02.966086 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 283/567] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 13 23:35:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:02.966883 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599afc2e-3d27-4665-8172-86fc6be435b4 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:02.983142 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-bf2c7978-66aa-4bf3-b87e-e194a921c464 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:35:02.983142 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:02.983142 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:02.983142 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:02.983142 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:02.983142 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:02.983142 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:02.983142 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:02.983142 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:02.983142 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:02.983142 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:02.983142 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:02.983142 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:35:02.983142 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:35:02.983142 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:35:02.984060 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:35:02.984060 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:02.984060 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:02.984060 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:02.984060 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:02.984060 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:02.984060 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:02.984060 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:02.984060 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:02.984060 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:02.984060 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:02.984060 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:02.984060 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:02.984060 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:02.984060 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:02.984060 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:02.984060 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:02.984993 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:35:02.984993 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:35:02.984993 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:35:02.984993 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:02.984993 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 285/568] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:35:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:02.985631 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c7978-66aa-4bf3-b87e-e194a921c464 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:03.076343 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599afc2e-3d27-4665-8172-86fc6be435b4 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:03.084700 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c7978-66aa-4bf3-b87e-e194a921c464 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:03.110012 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310dba71-b766-4bea-95f5-d1f82dbb8920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:03.110831 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dba71-b766-4bea-95f5-d1f82dbb8920 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:03.111121 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dba71-b766-4bea-95f5-d1f82dbb8920 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:03.111403 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dba71-b766-4bea-95f5-d1f82dbb8920 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:03.117721 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef488e-0990-47e9-97ba-1648a668169a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:03.118502 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef488e-0990-47e9-97ba-1648a668169a None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:03.118783 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef488e-0990-47e9-97ba-1648a668169a None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:03.118898 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310dba71-b766-4bea-95f5-d1f82dbb8920 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:03.119318 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef488e-0990-47e9-97ba-1648a668169a None admin] PATH_INFO: `/v3/projects/service` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:03.120753 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310dba71-b766-4bea-95f5-d1f82dbb8920 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:03.126020 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef488e-0990-47e9-97ba-1648a668169a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:03.127455 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef488e-0990-47e9-97ba-1648a668169a None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:03.129934 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:03.134993 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-310dba71-b766-4bea-95f5-d1f82dbb8920 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 13 23:35:03.134993 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:03.134993 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:03.134993 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:03.134993 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:03.134993 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:03.134993 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:03.134993 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:03.134993 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:03.134993 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:03.134993 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:03.134993 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:03.134993 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 23:35:03.134993 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 23:35:03.134993 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 23:35:03.134993 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 23:35:03.136550 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:03.136550 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:03.136550 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 23:35:03.136550 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 23:35:03.136550 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 23:35:03.136550 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 23:35:03.136550 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:03.136550 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:03.136550 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:03.136550 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:03.136550 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:03.136550 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:03.136550 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:03.136550 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:03.136550 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:03.136550 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:03.136550 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:03.136550 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:03.142717 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:03.142717 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:03.142717 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 23:35:03.142717 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 23:35:03.142717 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 23:35:03.142717 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 23:35:03.142717 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 23:35:03.142717 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 23:35:03.142717 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 13 23:35:03.142717 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:03.142717 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 284/569] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jul 13 23:35:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:03.142717 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310dba71-b766-4bea-95f5-d1f82dbb8920 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:03.143691 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-80ef488e-0990-47e9-97ba-1648a668169a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 23:35:03.143691 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:03.143691 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:03.143691 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:03.143691 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:03.143691 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:03.143691 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:03.143691 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:03.143691 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:03.143691 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:03.143691 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:03.143691 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:03.143691 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 23:35:03.143691 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 23:35:03.143691 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 23:35:03.144741 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 23:35:03.144741 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:03.144741 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:03.144741 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:03.144741 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:03.144741 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:03.144741 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:03.144741 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:03.144741 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:03.144741 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:03.144741 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:03.144741 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:03.144741 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:03.144741 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:03.144741 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:03.144741 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:03.144741 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:03.145784 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 23:35:03.145784 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 23:35:03.145784 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 23:35:03.145784 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 23:35:03.145784 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 23:35:03.145784 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 23:35:03.145784 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 23:35:03.145784 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:03.145784 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 286/570] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 13 23:35:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:03.146424 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef488e-0990-47e9-97ba-1648a668169a None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:03.181776 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:03.241417 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310dba71-b766-4bea-95f5-d1f82dbb8920 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:03.250507 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef488e-0990-47e9-97ba-1648a668169a None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:03.276947 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426feb40-c364-45e8-ba6a-630a93ee9d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:03.277830 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426feb40-c364-45e8-ba6a-630a93ee9d3d None admin] REQUEST_METHOD: `PUT` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:03.278116 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426feb40-c364-45e8-ba6a-630a93ee9d3d None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:03.278392 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426feb40-c364-45e8-ba6a-630a93ee9d3d None admin] PATH_INFO: `/v3/projects/11b8489ad08d40bc8f19a6ffa01c6897/users/a7e276c4bd434c028274e059a73c4060/roles/3f7019b9af764b4089ae3cd30e8e2fb9` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:03.283635 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b81849-519a-490c-b049-8d27caa1e3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:03.284279 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b81849-519a-490c-b049-8d27caa1e3a8 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:03.284565 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b81849-519a-490c-b049-8d27caa1e3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:03.284861 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b81849-519a-490c-b049-8d27caa1e3a8 None admin] PATH_INFO: `/v3/domains` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:03.285573 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b81849-519a-490c-b049-8d27caa1e3a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:03.285876 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b81849-519a-490c-b049-8d27caa1e3a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:03.287236 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b81849-519a-490c-b049-8d27caa1e3a8 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:03.292250 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426feb40-c364-45e8-ba6a-630a93ee9d3d None admin] RBAC: Authorizing `identity:create_grant(project_id=11b8489ad08d40bc8f19a6ffa01c6897, user_id=a7e276c4bd434c028274e059a73c4060, role_id=3f7019b9af764b4089ae3cd30e8e2fb9)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:03.293705 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426feb40-c364-45e8-ba6a-630a93ee9d3d None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:03.298688 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 287/571] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:35:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:03.299500 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b81849-519a-490c-b049-8d27caa1e3a8 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:03.316451 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 285/572] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jul 13 23:35:03 2022] PUT /identity/v3/projects/11b8489ad08d40bc8f19a6ffa01c6897/users/a7e276c4bd434c028274e059a73c4060/roles/3f7019b9af764b4089ae3cd30e8e2fb9 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 23:35:03.316451 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426feb40-c364-45e8-ba6a-630a93ee9d3d None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:03.375023 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:03.419193 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:03.425456 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b81849-519a-490c-b049-8d27caa1e3a8 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:03.431204 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426feb40-c364-45e8-ba6a-630a93ee9d3d None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:03.465740 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec9c71-adb9-4914-a85b-b2c5c85bf137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:03.466772 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec9c71-adb9-4914-a85b-b2c5c85bf137 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:03.467237 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec9c71-adb9-4914-a85b-b2c5c85bf137 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:03.467689 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec9c71-adb9-4914-a85b-b2c5c85bf137 None admin] PATH_INFO: `/v3/users` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:03.468744 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ec9c71-adb9-4914-a85b-b2c5c85bf137 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:03.469262 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ec9c71-adb9-4914-a85b-b2c5c85bf137 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:03.470275 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7023b62-0365-4282-a74e-4bf134704c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:03.470943 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7023b62-0365-4282-a74e-4bf134704c69 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:03.471229 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7023b62-0365-4282-a74e-4bf134704c69 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:03.471452 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ec9c71-adb9-4914-a85b-b2c5c85bf137 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:03.471563 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7023b62-0365-4282-a74e-4bf134704c69 None admin] PATH_INFO: `/v3/projects` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:03.472276 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7023b62-0365-4282-a74e-4bf134704c69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:03.472584 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7023b62-0365-4282-a74e-4bf134704c69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:03.474033 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7023b62-0365-4282-a74e-4bf134704c69 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:03.489845 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 286/573] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 13 23:35:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:03.490720 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7023b62-0365-4282-a74e-4bf134704c69 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:03.493999 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 288/574] 10.222.0.16 () {56 vars in 1139 bytes} [Wed Jul 13 23:35:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:03.499302 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec9c71-adb9-4914-a85b-b2c5c85bf137 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:03.609277 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7023b62-0365-4282-a74e-4bf134704c69 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:03.612635 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec9c71-adb9-4914-a85b-b2c5c85bf137 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:03.635156 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:03.648850 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb6f8c-d153-447d-8966-0785e14ef9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:03.649936 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb6f8c-d153-447d-8966-0785e14ef9ce None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:03.650270 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb6f8c-d153-447d-8966-0785e14ef9ce None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:03.650503 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb6f8c-d153-447d-8966-0785e14ef9ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:03.653322 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2eb3ac-d7e7-4c88-85f9-238bc1433dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:03.654104 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2eb3ac-d7e7-4c88-85f9-238bc1433dba None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:03.654384 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2eb3ac-d7e7-4c88-85f9-238bc1433dba None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:03.654655 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2eb3ac-d7e7-4c88-85f9-238bc1433dba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:03.658426 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb6f8c-d153-447d-8966-0785e14ef9ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:03.659893 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb6f8c-d153-447d-8966-0785e14ef9ce None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:03.664767 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2eb3ac-d7e7-4c88-85f9-238bc1433dba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:03.666224 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2eb3ac-d7e7-4c88-85f9-238bc1433dba None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:03.678634 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-b2eb6f8c-d153-447d-8966-0785e14ef9ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 23:35:03.678634 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:03.678634 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:03.678634 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:03.678634 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:03.678634 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:03.678634 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:03.678634 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:03.678634 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:03.678634 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:03.678634 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:03.678634 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:03.678634 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 23:35:03.678634 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 23:35:03.678634 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 23:35:03.679520 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 23:35:03.679520 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:03.679520 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:03.679520 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:03.679520 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:03.679520 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:03.679520 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:03.679520 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:03.679520 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:03.679520 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:03.679520 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:03.679520 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:03.679520 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:03.679520 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:03.679520 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:03.679520 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:03.679520 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:03.680434 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 23:35:03.680434 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 23:35:03.680434 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 23:35:03.680434 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 23:35:03.680434 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 23:35:03.680434 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 23:35:03.680434 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 23:35:03.680434 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:03.680434 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 287/575] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 13 23:35:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:03.680946 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb6f8c-d153-447d-8966-0785e14ef9ce None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:03.688712 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-4c2eb3ac-d7e7-4c88-85f9-238bc1433dba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:35:03.688712 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:03.688712 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:03.688712 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:03.688712 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:03.688712 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:03.688712 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:03.688712 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:03.688712 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:03.688712 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:03.688712 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:03.688712 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:03.688712 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:35:03.688712 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:35:03.688712 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:35:03.689888 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:35:03.689888 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:03.689888 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:03.689888 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:03.689888 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:03.689888 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:03.689888 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:03.689888 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:03.689888 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:03.689888 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:03.689888 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:03.689888 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:03.689888 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:03.689888 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:03.689888 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:03.689888 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:03.689888 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:03.690977 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:35:03.690977 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:35:03.690977 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:35:03.690977 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:03.696348 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 289/576] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:35:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:03.696348 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2eb3ac-d7e7-4c88-85f9-238bc1433dba None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:03.697482 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:03.791978 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb6f8c-d153-447d-8966-0785e14ef9ce None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:03.805533 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2eb3ac-d7e7-4c88-85f9-238bc1433dba None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:03.832563 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02374e6c-ba75-4482-9c54-1407b7418641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:03.833491 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02374e6c-ba75-4482-9c54-1407b7418641 None admin] REQUEST_METHOD: `PUT` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:03.833777 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02374e6c-ba75-4482-9c54-1407b7418641 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:03.834053 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02374e6c-ba75-4482-9c54-1407b7418641 None admin] PATH_INFO: `/v3/projects/11b8489ad08d40bc8f19a6ffa01c6897/users/15cdeb3131bc419f98ab11aaa4562d19/roles/3f7019b9af764b4089ae3cd30e8e2fb9` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:03.846827 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4323e-6aca-443a-a343-c416acb8614a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:03.847714 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4323e-6aca-443a-a343-c416acb8614a None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:03.848148 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4323e-6aca-443a-a343-c416acb8614a None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:03.848523 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02374e6c-ba75-4482-9c54-1407b7418641 None admin] RBAC: Authorizing `identity:create_grant(project_id=11b8489ad08d40bc8f19a6ffa01c6897, user_id=15cdeb3131bc419f98ab11aaa4562d19, role_id=3f7019b9af764b4089ae3cd30e8e2fb9)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:03.848732 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4323e-6aca-443a-a343-c416acb8614a None admin] PATH_INFO: `/v3/projects` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:03.849676 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e4323e-6aca-443a-a343-c416acb8614a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:03.850021 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02374e6c-ba75-4482-9c54-1407b7418641 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:03.850295 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e4323e-6aca-443a-a343-c416acb8614a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:03.851827 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e4323e-6aca-443a-a343-c416acb8614a None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:03.863550 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 288/577] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jul 13 23:35:03 2022] PUT /identity/v3/projects/11b8489ad08d40bc8f19a6ffa01c6897/users/15cdeb3131bc419f98ab11aaa4562d19/roles/3f7019b9af764b4089ae3cd30e8e2fb9 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 23:35:03.864357 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02374e6c-ba75-4482-9c54-1407b7418641 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:03.882277 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 290/578] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 13 23:35:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:03.884222 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4323e-6aca-443a-a343-c416acb8614a None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:03.928986 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:03.941937 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:03.996379 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02374e6c-ba75-4482-9c54-1407b7418641 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:04.026096 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4323e-6aca-443a-a343-c416acb8614a None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:04.035703 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4433fc9-5828-48f1-be24-c81ff6fd0dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:04.036395 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4433fc9-5828-48f1-be24-c81ff6fd0dae None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:04.036683 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4433fc9-5828-48f1-be24-c81ff6fd0dae None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:04.037024 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4433fc9-5828-48f1-be24-c81ff6fd0dae None admin] PATH_INFO: `/v3/domains` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:04.037771 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4433fc9-5828-48f1-be24-c81ff6fd0dae None admin] RBAC: Adding query filter params (name=Default) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:04.038083 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4433fc9-5828-48f1-be24-c81ff6fd0dae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:04.039491 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4433fc9-5828-48f1-be24-c81ff6fd0dae None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:04.053866 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 289/579] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:35:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:04.060740 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4433fc9-5828-48f1-be24-c81ff6fd0dae None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:04.081764 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe71e1-5bcc-4cb4-95a8-2a5b091566ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:04.082663 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe71e1-5bcc-4cb4-95a8-2a5b091566ff None admin] REQUEST_METHOD: `PUT` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:04.082947 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe71e1-5bcc-4cb4-95a8-2a5b091566ff None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:04.083223 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe71e1-5bcc-4cb4-95a8-2a5b091566ff None admin] PATH_INFO: `/v3/projects/11b8489ad08d40bc8f19a6ffa01c6897/users/ce654da79295477792be5ddb6e60ff12/roles/3f7019b9af764b4089ae3cd30e8e2fb9` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:04.100610 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe71e1-5bcc-4cb4-95a8-2a5b091566ff None admin] RBAC: Authorizing `identity:create_grant(project_id=11b8489ad08d40bc8f19a6ffa01c6897, user_id=ce654da79295477792be5ddb6e60ff12, role_id=3f7019b9af764b4089ae3cd30e8e2fb9)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:04.102317 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe71e1-5bcc-4cb4-95a8-2a5b091566ff None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:04.123169 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 291/580] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jul 13 23:35:03 2022] PUT /identity/v3/projects/11b8489ad08d40bc8f19a6ffa01c6897/users/ce654da79295477792be5ddb6e60ff12/roles/3f7019b9af764b4089ae3cd30e8e2fb9 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 23:35:04.194441 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4433fc9-5828-48f1-be24-c81ff6fd0dae None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:04.219514 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:04.236994 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0644f0e-5140-4250-a076-766b090d33e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:04.237817 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0644f0e-5140-4250-a076-766b090d33e5 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:04.238105 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0644f0e-5140-4250-a076-766b090d33e5 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:04.238382 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0644f0e-5140-4250-a076-766b090d33e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:04.247432 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0644f0e-5140-4250-a076-766b090d33e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:04.249076 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0644f0e-5140-4250-a076-766b090d33e5 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:04.266364 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-d0644f0e-5140-4250-a076-766b090d33e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 23:35:04.266364 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:04.266364 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:04.266364 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:04.266364 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:04.266364 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:04.266364 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:04.266364 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:04.266364 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:04.266364 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:04.266364 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:04.266364 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:04.266364 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 23:35:04.266364 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 23:35:04.266364 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 23:35:04.267402 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 23:35:04.267402 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:04.267402 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:04.267402 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:04.267402 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:04.267402 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:04.267402 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:04.267402 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:04.267402 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:04.267402 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:04.267402 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:04.267402 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:04.267402 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:04.267402 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:04.267402 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:04.267402 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:04.267402 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:04.268268 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 23:35:04.268268 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 23:35:04.268268 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 23:35:04.268268 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 23:35:04.268268 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 23:35:04.268268 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 23:35:04.268268 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 23:35:04.268268 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:04.268268 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 290/581] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 13 23:35:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:04.275127 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe71e1-5bcc-4cb4-95a8-2a5b091566ff None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:04.366297 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:04.389329 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe71e1-5bcc-4cb4-95a8-2a5b091566ff None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:04.424927 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363a178-0e4e-4b7c-bbca-967a41256258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:04.425880 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363a178-0e4e-4b7c-bbca-967a41256258 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:04.426309 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363a178-0e4e-4b7c-bbca-967a41256258 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:04.426761 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363a178-0e4e-4b7c-bbca-967a41256258 None admin] PATH_INFO: `/v3/projects` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:04.427691 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a363a178-0e4e-4b7c-bbca-967a41256258 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:04.428221 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a363a178-0e4e-4b7c-bbca-967a41256258 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:04.429905 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a363a178-0e4e-4b7c-bbca-967a41256258 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:04.447284 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 292/582] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 13 23:35:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:04.449315 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0644f0e-5140-4250-a076-766b090d33e5 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:04.577486 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0644f0e-5140-4250-a076-766b090d33e5 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:04.613914 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982d91a-fd47-4c56-ba46-bca4eb48d94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:04.615045 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982d91a-fd47-4c56-ba46-bca4eb48d94a None admin] REQUEST_METHOD: `PUT` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:04.615503 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982d91a-fd47-4c56-ba46-bca4eb48d94a None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:04.615936 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982d91a-fd47-4c56-ba46-bca4eb48d94a None admin] PATH_INFO: `/v3/projects/11b8489ad08d40bc8f19a6ffa01c6897/users/05f1ce71ea7c4301ae0bfc84a06c9c38/roles/3f7019b9af764b4089ae3cd30e8e2fb9` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:04.631054 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2982d91a-fd47-4c56-ba46-bca4eb48d94a None admin] RBAC: Authorizing `identity:create_grant(project_id=11b8489ad08d40bc8f19a6ffa01c6897, user_id=05f1ce71ea7c4301ae0bfc84a06c9c38, role_id=3f7019b9af764b4089ae3cd30e8e2fb9)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:04.632682 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2982d91a-fd47-4c56-ba46-bca4eb48d94a None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:04.652553 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 291/583] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jul 13 23:35:04 2022] PUT /identity/v3/projects/11b8489ad08d40bc8f19a6ffa01c6897/users/05f1ce71ea7c4301ae0bfc84a06c9c38/roles/3f7019b9af764b4089ae3cd30e8e2fb9 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 23:35:05.597081 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bceb1c-3c79-4a44-bd70-19d9faf7b217 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:05.597605 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bceb1c-3c79-4a44-bd70-19d9faf7b217 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:05.597870 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bceb1c-3c79-4a44-bd70-19d9faf7b217 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:05.599570 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 293/584] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:35:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:35:05.604797 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb491a-c5cf-4fef-905f-a6a625fc91fa None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:05.605480 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb491a-c5cf-4fef-905f-a6a625fc91fa None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:05.605480 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb491a-c5cf-4fef-905f-a6a625fc91fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:05.624348 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-c6cb491a-c5cf-4fef-905f-a6a625fc91fa None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:35:05.625691 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-c6cb491a-c5cf-4fef-905f-a6a625fc91fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:35:05.654048 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:05.704382 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 292/585] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:35:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:35:05.730244 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bceb1c-3c79-4a44-bd70-19d9faf7b217 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:05.840930 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bceb1c-3c79-4a44-bd70-19d9faf7b217 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:05.883880 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875159cb-a9ec-4cd2-a4b4-b7b8207cbe25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:05.884959 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875159cb-a9ec-4cd2-a4b4-b7b8207cbe25 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:05.885413 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875159cb-a9ec-4cd2-a4b4-b7b8207cbe25 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:05.886048 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875159cb-a9ec-4cd2-a4b4-b7b8207cbe25 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:05.897453 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:05.901808 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875159cb-a9ec-4cd2-a4b4-b7b8207cbe25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:35:05.910076 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-875159cb-a9ec-4cd2-a4b4-b7b8207cbe25 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 23:35:05.910076 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:05.910076 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:05.910076 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:05.910076 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:05.910076 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:05.910076 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:05.910076 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:05.910076 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:05.910076 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:05.910076 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:05.910076 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:05.910076 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:35:05.910076 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:35:05.910076 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:35:05.910076 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:35:05.911336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:35:05.911336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:35:05.911336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:35:05.911336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:35:05.911336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:05.911336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:05.911336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:05.911336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:05.911336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:05.911336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:05.911336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:05.911336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:05.911336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:05.911336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:05.911336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:05.911336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:05.912188 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:05.912188 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:05.912188 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:05.912188 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:05.912188 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:35:05.912188 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:35:05.912188 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:35:05.912188 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:35:05.912188 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:35:05.912188 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:35:05.912188 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 23:35:05.912188 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:05.912188 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 294/586] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jul 13 23:35:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:05.918939 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb491a-c5cf-4fef-905f-a6a625fc91fa None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:06.051029 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb491a-c5cf-4fef-905f-a6a625fc91fa None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:06.097667 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38330fed-0371-45a1-a425-78c0de3763ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:06.098509 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38330fed-0371-45a1-a425-78c0de3763ce None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:06.099034 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38330fed-0371-45a1-a425-78c0de3763ce None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:06.099456 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38330fed-0371-45a1-a425-78c0de3763ce None admin] PATH_INFO: `/v3/roles` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:06.100240 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38330fed-0371-45a1-a425-78c0de3763ce None admin] RBAC: Adding query filter params (name=service) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:06.100804 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38330fed-0371-45a1-a425-78c0de3763ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:06.102750 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38330fed-0371-45a1-a425-78c0de3763ce None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:06.115530 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 293/587] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jul 13 23:35:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:06.121296 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875159cb-a9ec-4cd2-a4b4-b7b8207cbe25 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:06.237981 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875159cb-a9ec-4cd2-a4b4-b7b8207cbe25 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:06.275617 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc201ce-965f-450f-80b4-3550049dacd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:06.277015 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc201ce-965f-450f-80b4-3550049dacd2 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:06.277314 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc201ce-965f-450f-80b4-3550049dacd2 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:06.277636 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc201ce-965f-450f-80b4-3550049dacd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:06.291424 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc201ce-965f-450f-80b4-3550049dacd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:06.293923 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc201ce-965f-450f-80b4-3550049dacd2 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:06.314535 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-4bc201ce-965f-450f-80b4-3550049dacd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:35:06.314535 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:06.314535 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:06.314535 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:06.314535 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:06.314535 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:06.314535 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:06.314535 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:06.314535 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:06.314535 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:06.314535 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:06.314535 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:06.314535 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:35:06.314535 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:35:06.314535 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:35:06.315495 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:35:06.315495 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:06.315495 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:06.315495 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:06.315495 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:06.315495 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:06.315495 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:06.315495 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:06.315495 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:06.315495 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:06.315495 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:06.315495 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:06.315495 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:06.315495 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:06.315495 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:06.315495 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:06.315495 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:06.316432 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:35:06.316432 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:35:06.316432 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:35:06.316432 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:06.316432 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 295/588] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:35:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:06.322708 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38330fed-0371-45a1-a425-78c0de3763ce None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:06.357376 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:06.443278 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38330fed-0371-45a1-a425-78c0de3763ce None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:06.485589 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d545e04-09b1-4f8e-bd4c-a186827a95e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:06.486660 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d545e04-09b1-4f8e-bd4c-a186827a95e8 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:06.487170 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d545e04-09b1-4f8e-bd4c-a186827a95e8 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:06.487649 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d545e04-09b1-4f8e-bd4c-a186827a95e8 None admin] PATH_INFO: `/v3/domains` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:06.488626 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d545e04-09b1-4f8e-bd4c-a186827a95e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:06.489195 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d545e04-09b1-4f8e-bd4c-a186827a95e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:06.491332 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d545e04-09b1-4f8e-bd4c-a186827a95e8 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:06.507991 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 294/589] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:35:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:06.515179 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc201ce-965f-450f-80b4-3550049dacd2 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:06.549498 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085f477-c247-4456-9447-d38da2a2a716 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:06.550031 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085f477-c247-4456-9447-d38da2a2a716 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:06.550519 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085f477-c247-4456-9447-d38da2a2a716 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:06.552333 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 295/590] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:35:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:35:06.558271 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797992d-63e9-4a5c-9f44-8ec0e35b7dd7 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:06.558610 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797992d-63e9-4a5c-9f44-8ec0e35b7dd7 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:06.559048 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797992d-63e9-4a5c-9f44-8ec0e35b7dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:06.582900 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-5797992d-63e9-4a5c-9f44-8ec0e35b7dd7 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:35:06.584123 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-5797992d-63e9-4a5c-9f44-8ec0e35b7dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:35:06.585523 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:06.645389 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc201ce-965f-450f-80b4-3550049dacd2 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:06.669961 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 296/591] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:35:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 23:35:06.671579 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cdb03d-8444-4166-a637-2f188119fafa None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:06.671874 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cdb03d-8444-4166-a637-2f188119fafa None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:06.672157 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cdb03d-8444-4166-a637-2f188119fafa None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:06.677120 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 297/592] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:35:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:35:06.682212 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b36404-b7d0-4e07-b50f-b26b9f990490 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:06.682553 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b36404-b7d0-4e07-b50f-b26b9f990490 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:06.682886 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b36404-b7d0-4e07-b50f-b26b9f990490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:06.695683 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b7346-8db7-4e47-a293-3d5888d9905e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:06.695683 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b7346-8db7-4e47-a293-3d5888d9905e None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:06.695683 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b7346-8db7-4e47-a293-3d5888d9905e None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:06.695683 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b7346-8db7-4e47-a293-3d5888d9905e None admin] PATH_INFO: `/v3/users/nova` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:06.705254 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b7346-8db7-4e47-a293-3d5888d9905e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:06.706712 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b7346-8db7-4e47-a293-3d5888d9905e None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:06.718897 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-52b36404-b7d0-4e07-b50f-b26b9f990490 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:35:06.720095 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-52b36404-b7d0-4e07-b50f-b26b9f990490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:35:06.722208 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-983b7346-8db7-4e47-a293-3d5888d9905e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 23:35:06.722208 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:06.722208 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:06.722208 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:06.722208 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:06.722208 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:06.722208 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:06.722208 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:06.722208 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:06.722208 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:06.722208 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:06.722208 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:06.722208 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 23:35:06.722208 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 23:35:06.722208 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 23:35:06.722208 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 23:35:06.723210 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:06.723210 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:06.723210 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 23:35:06.723210 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 23:35:06.723210 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 23:35:06.723210 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 23:35:06.723210 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:06.723210 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:06.723210 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:06.723210 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:06.723210 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:06.723210 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:06.723210 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:06.723210 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:06.723210 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:06.723210 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:06.723210 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:06.723210 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:06.724114 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:06.724114 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:06.724114 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 23:35:06.724114 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 23:35:06.724114 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 23:35:06.724114 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 23:35:06.724114 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 23:35:06.724114 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 23:35:06.724114 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 13 23:35:06.724114 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:06.724114 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 296/593] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jul 13 23:35:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:06.724707 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b7346-8db7-4e47-a293-3d5888d9905e None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:06.733213 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:06.796877 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 298/594] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:35:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 23:35:06.796877 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b36404-b7d0-4e07-b50f-b26b9f990490 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:06.847089 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b7346-8db7-4e47-a293-3d5888d9905e None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:06.862469 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:06.887632 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1109ab-6ed7-4599-a173-476edcee0ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:06.889015 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1109ab-6ed7-4599-a173-476edcee0ca9 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:06.889308 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1109ab-6ed7-4599-a173-476edcee0ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:06.889586 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1109ab-6ed7-4599-a173-476edcee0ca9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:06.901320 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1109ab-6ed7-4599-a173-476edcee0ca9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:35:06.905318 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b36404-b7d0-4e07-b50f-b26b9f990490 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:06.909822 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-1f1109ab-6ed7-4599-a173-476edcee0ca9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 23:35:06.909822 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:06.909822 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:06.909822 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:06.909822 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:06.909822 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:06.909822 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:06.909822 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:06.909822 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:06.909822 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:06.909822 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:06.909822 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:06.909822 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:35:06.909822 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:35:06.909822 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:35:06.909822 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:35:06.910817 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:35:06.910817 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:35:06.910817 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:35:06.910817 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:35:06.910817 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:06.910817 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:06.910817 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:06.910817 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:06.910817 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:06.910817 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:06.910817 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:06.910817 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:06.910817 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:06.910817 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:06.910817 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:06.910817 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:06.918301 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:06.918301 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:06.918301 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:06.918301 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:06.918301 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:35:06.918301 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:35:06.918301 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:35:06.918301 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:35:06.918301 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:35:06.918301 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:35:06.918301 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 23:35:06.918301 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:06.918301 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 297/595] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jul 13 23:35:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:06.918301 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1109ab-6ed7-4599-a173-476edcee0ca9 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:06.949399 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1a555-78de-46ee-a697-f80521ccb319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:06.950164 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1a555-78de-46ee-a697-f80521ccb319 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:06.950445 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1a555-78de-46ee-a697-f80521ccb319 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:06.950926 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1a555-78de-46ee-a697-f80521ccb319 None admin] PATH_INFO: `/v3/users` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:06.951546 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a1a555-78de-46ee-a697-f80521ccb319 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:06.951847 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a1a555-78de-46ee-a697-f80521ccb319 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:06.953310 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a1a555-78de-46ee-a697-f80521ccb319 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:06.969865 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:06.973581 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 299/596] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 13 23:35:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:06.974321 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1a555-78de-46ee-a697-f80521ccb319 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:07.032998 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1109ab-6ed7-4599-a173-476edcee0ca9 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:07.070233 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf7d9d7-cd5d-424c-a7da-10c23087f22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:07.071029 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7d9d7-cd5d-424c-a7da-10c23087f22b None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:07.071317 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7d9d7-cd5d-424c-a7da-10c23087f22b None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:07.071588 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7d9d7-cd5d-424c-a7da-10c23087f22b None admin] PATH_INFO: `/v3/roles/service` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:07.081520 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1a555-78de-46ee-a697-f80521ccb319 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:07.081840 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf7d9d7-cd5d-424c-a7da-10c23087f22b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:35:07.090254 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-4cf7d9d7-cd5d-424c-a7da-10c23087f22b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 23:35:07.090254 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:07.090254 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:07.090254 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:07.090254 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:07.090254 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:07.090254 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:07.090254 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:07.090254 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:07.090254 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:07.090254 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:07.090254 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:07.090254 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:35:07.090254 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:35:07.090254 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:35:07.090254 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:35:07.091170 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:35:07.091170 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:35:07.091170 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:35:07.091170 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:35:07.091170 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:07.091170 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:07.091170 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:07.091170 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:07.091170 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:07.091170 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:07.091170 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:07.091170 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:07.091170 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:07.091170 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:07.091170 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:07.091170 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:07.091996 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:07.091996 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:07.091996 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:07.091996 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:07.091996 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:35:07.091996 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:35:07.091996 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:35:07.091996 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:35:07.091996 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:35:07.091996 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:35:07.091996 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 23:35:07.091996 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:07.092985 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 298/597] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jul 13 23:35:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:07.094000 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf7d9d7-cd5d-424c-a7da-10c23087f22b None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:07.116915 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985903d-8d96-448a-8a72-b31913dfaa5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:07.117585 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985903d-8d96-448a-8a72-b31913dfaa5f None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:07.117868 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985903d-8d96-448a-8a72-b31913dfaa5f None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:07.118147 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985903d-8d96-448a-8a72-b31913dfaa5f None admin] PATH_INFO: `/v3/roles` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:07.118882 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3985903d-8d96-448a-8a72-b31913dfaa5f None admin] RBAC: Adding query filter params (name=service) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:07.119188 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3985903d-8d96-448a-8a72-b31913dfaa5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:07.120614 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3985903d-8d96-448a-8a72-b31913dfaa5f None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:07.126688 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:07.128974 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 300/598] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jul 13 23:35:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:07.130308 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380421f-b3a7-49ef-84ef-8d81fea12dec None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:07.130597 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380421f-b3a7-49ef-84ef-8d81fea12dec None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:07.130876 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380421f-b3a7-49ef-84ef-8d81fea12dec None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:07.132326 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 301/599] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:35:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:35:07.133003 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380421f-b3a7-49ef-84ef-8d81fea12dec None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:07.195635 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:07.201148 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf7d9d7-cd5d-424c-a7da-10c23087f22b None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:07.235231 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91920418-43e7-4c9c-bc5c-b4d79b92b213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:07.235880 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91920418-43e7-4c9c-bc5c-b4d79b92b213 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:07.236166 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91920418-43e7-4c9c-bc5c-b4d79b92b213 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:07.236452 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91920418-43e7-4c9c-bc5c-b4d79b92b213 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:07.237905 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380421f-b3a7-49ef-84ef-8d81fea12dec None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:07.271944 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c759fc-03be-43a4-962b-99a6d0f9c04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:07.272596 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c759fc-03be-43a4-962b-99a6d0f9c04e None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:07.272921 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c759fc-03be-43a4-962b-99a6d0f9c04e None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:07.273204 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c759fc-03be-43a4-962b-99a6d0f9c04e None admin] PATH_INFO: `/v3/roles` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:07.273946 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c759fc-03be-43a4-962b-99a6d0f9c04e None admin] RBAC: Adding query filter params (name=service) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:07.274257 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c759fc-03be-43a4-962b-99a6d0f9c04e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:07.275615 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c759fc-03be-43a4-962b-99a6d0f9c04e None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:07.283416 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 302/600] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jul 13 23:35:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:07.284200 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c759fc-03be-43a4-962b-99a6d0f9c04e None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:07.304621 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91920418-43e7-4c9c-bc5c-b4d79b92b213 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:07.306122 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91920418-43e7-4c9c-bc5c-b4d79b92b213 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:07.335929 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:07.382343 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c759fc-03be-43a4-962b-99a6d0f9c04e None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:07.407355 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 299/601] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 13 23:35:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 23:35:07.407519 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:07.407600 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91d467-6ce6-44d7-ac3d-c1d6c6efd080 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:07.407600 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91d467-6ce6-44d7-ac3d-c1d6c6efd080 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:07.407600 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91d467-6ce6-44d7-ac3d-c1d6c6efd080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:07.418900 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e39a11-e2bb-4e4f-8fa5-05ea33e8db79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:07.419685 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e39a11-e2bb-4e4f-8fa5-05ea33e8db79 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:07.419968 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e39a11-e2bb-4e4f-8fa5-05ea33e8db79 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:07.420243 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e39a11-e2bb-4e4f-8fa5-05ea33e8db79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:07.422970 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-ff91d467-6ce6-44d7-ac3d-c1d6c6efd080 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:35:07.424155 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-ff91d467-6ce6-44d7-ac3d-c1d6c6efd080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:35:07.430532 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e39a11-e2bb-4e4f-8fa5-05ea33e8db79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:07.431978 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e39a11-e2bb-4e4f-8fa5-05ea33e8db79 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:07.449928 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-94e39a11-e2bb-4e4f-8fa5-05ea33e8db79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:35:07.449928 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:07.449928 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:07.449928 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:07.449928 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:07.449928 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:07.449928 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:07.449928 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:07.449928 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:07.449928 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:07.449928 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:07.449928 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:07.449928 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:35:07.449928 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:35:07.449928 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:35:07.450973 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:35:07.450973 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:07.450973 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:07.450973 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:07.450973 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:07.450973 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:07.450973 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:07.450973 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:07.450973 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:07.450973 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:07.450973 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:07.450973 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:07.450973 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:07.450973 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:07.450973 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:07.450973 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:07.450973 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:07.456535 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:35:07.456535 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:35:07.456535 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:35:07.456535 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:07.456535 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 303/602] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:35:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:07.456535 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e39a11-e2bb-4e4f-8fa5-05ea33e8db79 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:07.497420 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 300/603] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:35:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:35:07.498451 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91d467-6ce6-44d7-ac3d-c1d6c6efd080 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:07.554944 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e39a11-e2bb-4e4f-8fa5-05ea33e8db79 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:07.560863 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:07.590824 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6dedf8-733d-4940-b822-5ee0ea37fdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:07.591706 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6dedf8-733d-4940-b822-5ee0ea37fdd1 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:07.592022 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6dedf8-733d-4940-b822-5ee0ea37fdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:07.592349 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6dedf8-733d-4940-b822-5ee0ea37fdd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:07.604764 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6dedf8-733d-4940-b822-5ee0ea37fdd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:07.606179 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6dedf8-733d-4940-b822-5ee0ea37fdd1 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:07.609115 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91d467-6ce6-44d7-ac3d-c1d6c6efd080 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:07.624378 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-ec6dedf8-733d-4940-b822-5ee0ea37fdd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:35:07.624378 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:07.624378 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:07.624378 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:07.624378 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:07.624378 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:07.624378 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:07.624378 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:07.624378 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:07.624378 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:07.624378 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:07.624378 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:07.624378 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:35:07.624378 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:35:07.624378 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:35:07.625388 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:35:07.625388 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:07.625388 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:07.625388 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:07.625388 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:07.625388 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:07.625388 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:07.625388 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:07.625388 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:07.625388 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:07.625388 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:07.625388 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:07.625388 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:07.625388 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:07.625388 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:07.625388 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:07.625388 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:07.626342 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:35:07.626342 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:35:07.626342 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:35:07.626342 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:07.626342 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 304/604] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:35:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:07.626884 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6dedf8-733d-4940-b822-5ee0ea37fdd1 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:07.661303 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20527d2b-934e-40c4-84b8-c737594e6a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:07.662107 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20527d2b-934e-40c4-84b8-c737594e6a05 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:07.662390 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20527d2b-934e-40c4-84b8-c737594e6a05 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:07.662668 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20527d2b-934e-40c4-84b8-c737594e6a05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:07.664445 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:07.674553 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20527d2b-934e-40c4-84b8-c737594e6a05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:07.676004 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20527d2b-934e-40c4-84b8-c737594e6a05 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:07.695348 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-20527d2b-934e-40c4-84b8-c737594e6a05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:35:07.695348 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:07.695348 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:07.695348 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:07.695348 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:07.695348 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:07.695348 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:07.695348 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:07.695348 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:07.695348 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:07.695348 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:07.695348 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:07.695348 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:35:07.695348 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:35:07.695348 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:35:07.696615 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:35:07.696615 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:07.696615 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:07.696615 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:07.696615 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:07.696615 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:07.696615 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:07.696615 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:07.696615 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:07.696615 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:07.696615 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:07.696615 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:07.696615 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:07.696615 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:07.696615 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:07.696615 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:07.696615 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:07.697773 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:35:07.697773 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:35:07.697773 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:35:07.697773 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:07.701026 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 301/605] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:35:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:07.702146 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20527d2b-934e-40c4-84b8-c737594e6a05 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:07.759870 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6dedf8-733d-4940-b822-5ee0ea37fdd1 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:07.794341 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e984bb0-c88a-4bf0-abb7-c9f65618dccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:07.794992 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e984bb0-c88a-4bf0-abb7-c9f65618dccb None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:07.795275 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e984bb0-c88a-4bf0-abb7-c9f65618dccb None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:07.795613 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e984bb0-c88a-4bf0-abb7-c9f65618dccb None admin] PATH_INFO: `/v3/domains` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:07.796326 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e984bb0-c88a-4bf0-abb7-c9f65618dccb None admin] RBAC: Adding query filter params (name=Default) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:07.796634 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e984bb0-c88a-4bf0-abb7-c9f65618dccb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:07.798041 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e984bb0-c88a-4bf0-abb7-c9f65618dccb None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:07.805741 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20527d2b-934e-40c4-84b8-c737594e6a05 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:07.809961 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 305/606] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:35:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:07.810744 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e984bb0-c88a-4bf0-abb7-c9f65618dccb None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:07.820758 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:07.841790 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1d9dd-e222-4ef7-b05c-e993e22b5c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:07.842578 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1d9dd-e222-4ef7-b05c-e993e22b5c2e None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:07.842861 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1d9dd-e222-4ef7-b05c-e993e22b5c2e None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:07.843125 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1d9dd-e222-4ef7-b05c-e993e22b5c2e None admin] PATH_INFO: `/v3/roles/service` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:07.853010 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1d9dd-e222-4ef7-b05c-e993e22b5c2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:35:07.860879 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-a0e1d9dd-e222-4ef7-b05c-e993e22b5c2e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 23:35:07.860879 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:07.860879 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:07.860879 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:07.860879 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:07.860879 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:07.860879 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:07.860879 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:07.860879 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:07.860879 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:07.860879 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:07.860879 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:07.860879 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:35:07.860879 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:35:07.860879 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:35:07.860879 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:35:07.861845 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:35:07.861845 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:35:07.861845 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:35:07.861845 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:35:07.861845 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:07.861845 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:07.861845 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:07.861845 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:07.861845 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:07.861845 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:07.861845 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:07.861845 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:07.861845 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:07.861845 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:07.861845 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:07.861845 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:07.862703 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:07.862703 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:07.862703 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:07.862703 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:07.862703 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:35:07.862703 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:35:07.862703 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:35:07.862703 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:35:07.862703 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:35:07.862703 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:35:07.862703 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 23:35:07.862703 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:07.862703 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 302/607] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jul 13 23:35:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:07.863404 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1d9dd-e222-4ef7-b05c-e993e22b5c2e None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:07.903699 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:07.915754 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e984bb0-c88a-4bf0-abb7-c9f65618dccb None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:07.949597 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8f00b-bcf0-46a7-ae34-f9389db68ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:07.950241 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8f00b-bcf0-46a7-ae34-f9389db68ecf None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:07.950520 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8f00b-bcf0-46a7-ae34-f9389db68ecf None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:07.951133 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8f00b-bcf0-46a7-ae34-f9389db68ecf None admin] PATH_INFO: `/v3/domains` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:07.951488 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f8f00b-bcf0-46a7-ae34-f9389db68ecf None admin] RBAC: Adding query filter params (name=Default) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:07.951793 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f8f00b-bcf0-46a7-ae34-f9389db68ecf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:07.953162 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f8f00b-bcf0-46a7-ae34-f9389db68ecf None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:07.964657 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 306/608] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:35:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:07.965631 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8f00b-bcf0-46a7-ae34-f9389db68ecf None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:07.969435 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1d9dd-e222-4ef7-b05c-e993e22b5c2e None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:08.002427 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e789c9c-3853-46b1-a931-bcae47b878d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:08.003080 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e789c9c-3853-46b1-a931-bcae47b878d5 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:08.003363 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e789c9c-3853-46b1-a931-bcae47b878d5 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:08.003643 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e789c9c-3853-46b1-a931-bcae47b878d5 None admin] PATH_INFO: `/v3/domains` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:08.004347 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e789c9c-3853-46b1-a931-bcae47b878d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:08.004650 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e789c9c-3853-46b1-a931-bcae47b878d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:08.006021 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e789c9c-3853-46b1-a931-bcae47b878d5 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:08.017565 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 303/609] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:35:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:08.018337 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e789c9c-3853-46b1-a931-bcae47b878d5 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:08.051060 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:08.067310 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8f00b-bcf0-46a7-ae34-f9389db68ecf None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:08.100965 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d9d79-fd4e-4733-b4ab-0094d50bdaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:08.101756 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d9d79-fd4e-4733-b4ab-0094d50bdaa6 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:08.102039 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d9d79-fd4e-4733-b4ab-0094d50bdaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:08.102323 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d9d79-fd4e-4733-b4ab-0094d50bdaa6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:08.110470 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d9d79-fd4e-4733-b4ab-0094d50bdaa6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:08.111931 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d9d79-fd4e-4733-b4ab-0094d50bdaa6 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:08.117094 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e789c9c-3853-46b1-a931-bcae47b878d5 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:08.127233 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-d32d9d79-fd4e-4733-b4ab-0094d50bdaa6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 13 23:35:08.127233 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:08.127233 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:08.127233 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:08.127233 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:08.127233 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:08.127233 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:08.127233 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:08.127233 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:08.127233 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:08.127233 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:08.127233 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:08.127233 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 23:35:08.127233 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 23:35:08.127233 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 23:35:08.127233 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 23:35:08.128225 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:08.128225 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:08.128225 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 23:35:08.128225 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 23:35:08.128225 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 23:35:08.128225 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 23:35:08.128225 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:08.128225 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:08.128225 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:08.128225 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:08.128225 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:08.128225 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:08.128225 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:08.128225 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:08.128225 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:08.128225 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:08.128225 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:08.128225 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:08.129197 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:08.129197 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:08.129197 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 23:35:08.129197 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 23:35:08.129197 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 23:35:08.129197 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 23:35:08.129197 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 23:35:08.129197 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 23:35:08.129197 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 13 23:35:08.129197 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:08.129197 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 307/610] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:35:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:08.129197 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d9d79-fd4e-4733-b4ab-0094d50bdaa6 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:08.142334 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:08.154335 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928091fe-9bc1-482f-be11-94159902eb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:08.154997 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928091fe-9bc1-482f-be11-94159902eb43 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:08.155281 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928091fe-9bc1-482f-be11-94159902eb43 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:08.155584 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928091fe-9bc1-482f-be11-94159902eb43 None admin] PATH_INFO: `/v3/roles` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:08.156322 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928091fe-9bc1-482f-be11-94159902eb43 None admin] RBAC: Adding query filter params (name=service) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:08.156629 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928091fe-9bc1-482f-be11-94159902eb43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:08.158014 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928091fe-9bc1-482f-be11-94159902eb43 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:08.165832 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 304/611] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jul 13 23:35:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:08.166595 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928091fe-9bc1-482f-be11-94159902eb43 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:08.231105 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d9d79-fd4e-4733-b4ab-0094d50bdaa6 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:08.258967 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:08.265865 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de8112-23fc-4e42-8712-8a0b12e380a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:08.266424 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928091fe-9bc1-482f-be11-94159902eb43 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:08.266654 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de8112-23fc-4e42-8712-8a0b12e380a5 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:08.266940 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de8112-23fc-4e42-8712-8a0b12e380a5 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:08.267219 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de8112-23fc-4e42-8712-8a0b12e380a5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:08.274589 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6de8112-23fc-4e42-8712-8a0b12e380a5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:08.276024 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6de8112-23fc-4e42-8712-8a0b12e380a5 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:08.290422 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-a6de8112-23fc-4e42-8712-8a0b12e380a5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 13 23:35:08.290422 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:08.290422 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:08.290422 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:08.290422 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:08.290422 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:08.290422 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:08.290422 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:08.290422 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:08.290422 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:08.290422 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:08.290422 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:08.290422 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 23:35:08.290422 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 23:35:08.290422 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 23:35:08.290422 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 23:35:08.291319 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:08.291319 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:08.291319 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 23:35:08.291319 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 23:35:08.291319 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 23:35:08.291319 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 23:35:08.291319 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:08.291319 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:08.291319 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:08.291319 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:08.291319 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:08.291319 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:08.291319 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:08.291319 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:08.291319 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:08.291319 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:08.291319 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:08.291319 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:08.293282 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:08.293282 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:08.293282 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 23:35:08.293282 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 23:35:08.293282 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 23:35:08.293282 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 23:35:08.293282 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 23:35:08.293282 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 23:35:08.293282 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 13 23:35:08.293282 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:08.293282 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 308/612] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:35:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:08.294131 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de8112-23fc-4e42-8712-8a0b12e380a5 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:08.302826 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b15f6c-1796-472b-8fa7-46a197e4803d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:08.303615 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b15f6c-1796-472b-8fa7-46a197e4803d None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:08.303898 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b15f6c-1796-472b-8fa7-46a197e4803d None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:08.304167 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b15f6c-1796-472b-8fa7-46a197e4803d None admin] PATH_INFO: `/v3/projects/service` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:08.311587 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b15f6c-1796-472b-8fa7-46a197e4803d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:08.313072 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b15f6c-1796-472b-8fa7-46a197e4803d None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:08.327406 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-e0b15f6c-1796-472b-8fa7-46a197e4803d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 23:35:08.327406 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:08.327406 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:08.327406 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:08.327406 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:08.327406 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:08.327406 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:08.327406 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:08.327406 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:08.327406 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:08.327406 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:08.327406 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:08.327406 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 23:35:08.327406 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 23:35:08.327406 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 23:35:08.328431 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 23:35:08.328431 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:08.328431 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:08.328431 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:08.328431 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:08.328431 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:08.328431 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:08.328431 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:08.328431 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:08.328431 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:08.328431 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:08.328431 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:08.328431 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:08.328431 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:08.328431 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:08.328431 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:08.328431 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:08.329394 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 23:35:08.329394 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 23:35:08.329394 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 23:35:08.329394 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 23:35:08.329394 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 23:35:08.329394 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 23:35:08.329394 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 23:35:08.329394 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:08.329394 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 305/613] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 13 23:35:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:08.329869 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b15f6c-1796-472b-8fa7-46a197e4803d None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:08.365772 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:08.399866 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de8112-23fc-4e42-8712-8a0b12e380a5 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:08.426732 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b15f6c-1796-472b-8fa7-46a197e4803d None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:08.432498 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe9f4a-6ce1-41f8-9a20-453ba8ceda4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:08.433329 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe9f4a-6ce1-41f8-9a20-453ba8ceda4b None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:08.433613 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe9f4a-6ce1-41f8-9a20-453ba8ceda4b None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:08.433894 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe9f4a-6ce1-41f8-9a20-453ba8ceda4b None admin] PATH_INFO: `/v3/users` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:08.434709 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe9f4a-6ce1-41f8-9a20-453ba8ceda4b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:08.435016 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe9f4a-6ce1-41f8-9a20-453ba8ceda4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:08.436425 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe9f4a-6ce1-41f8-9a20-453ba8ceda4b None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:08.453459 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 309/614] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Jul 13 23:35:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:08.454255 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe9f4a-6ce1-41f8-9a20-453ba8ceda4b None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:08.459402 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d0231-0979-4c9c-9667-7aa6aaf79ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:08.460190 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d0231-0979-4c9c-9667-7aa6aaf79ccc None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:08.460471 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d0231-0979-4c9c-9667-7aa6aaf79ccc None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:08.460777 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d0231-0979-4c9c-9667-7aa6aaf79ccc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:08.471316 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d0231-0979-4c9c-9667-7aa6aaf79ccc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:08.472757 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d0231-0979-4c9c-9667-7aa6aaf79ccc None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:08.490014 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-1d0d0231-0979-4c9c-9667-7aa6aaf79ccc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:35:08.490014 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:08.490014 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:08.490014 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:08.490014 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:08.490014 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:08.490014 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:08.490014 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:08.490014 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:08.490014 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:08.490014 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:08.490014 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:08.490014 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:35:08.490014 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:35:08.490014 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:35:08.491034 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:35:08.491034 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:08.491034 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:08.491034 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:08.491034 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:08.491034 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:08.491034 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:08.491034 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:08.491034 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:08.491034 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:08.491034 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:08.491034 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:08.491034 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:08.491034 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:08.491034 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:08.491034 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:08.491034 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:08.497208 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:35:08.497208 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:35:08.497208 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:35:08.497208 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:08.497208 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 306/615] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:35:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:08.497208 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d0231-0979-4c9c-9667-7aa6aaf79ccc None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:08.504466 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:08.567104 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe9f4a-6ce1-41f8-9a20-453ba8ceda4b None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:08.592387 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:08.597419 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d0231-0979-4c9c-9667-7aa6aaf79ccc None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:08.602454 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ade1a-0395-4863-99ae-fa8453ef5623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:08.603121 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ade1a-0395-4863-99ae-fa8453ef5623 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:08.603403 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ade1a-0395-4863-99ae-fa8453ef5623 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:08.603676 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ade1a-0395-4863-99ae-fa8453ef5623 None admin] PATH_INFO: `/v3/users` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:08.604652 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ade1a-0395-4863-99ae-fa8453ef5623 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:08.605205 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ade1a-0395-4863-99ae-fa8453ef5623 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:08.606280 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ade1a-0395-4863-99ae-fa8453ef5623 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:08.623488 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 310/616] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Jul 13 23:35:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:08.624282 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ade1a-0395-4863-99ae-fa8453ef5623 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:08.634311 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db8131-6f3d-47c4-bb42-e9a4b2f9b976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:08.634996 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db8131-6f3d-47c4-bb42-e9a4b2f9b976 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:08.635282 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db8131-6f3d-47c4-bb42-e9a4b2f9b976 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:08.635599 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db8131-6f3d-47c4-bb42-e9a4b2f9b976 None admin] PATH_INFO: `/v3/projects` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:08.637037 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0db8131-6f3d-47c4-bb42-e9a4b2f9b976 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:08.637614 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0db8131-6f3d-47c4-bb42-e9a4b2f9b976 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:08.639049 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0db8131-6f3d-47c4-bb42-e9a4b2f9b976 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:08.650757 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 307/617] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 13 23:35:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:08.652246 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db8131-6f3d-47c4-bb42-e9a4b2f9b976 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:08.720085 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:08.726689 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ade1a-0395-4863-99ae-fa8453ef5623 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:08.754984 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db8131-6f3d-47c4-bb42-e9a4b2f9b976 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:08.760389 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc928558-551d-447d-8d48-c1011d86911c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:08.761643 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc928558-551d-447d-8d48-c1011d86911c None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:08.761927 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc928558-551d-447d-8d48-c1011d86911c None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:08.762203 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc928558-551d-447d-8d48-c1011d86911c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:08.788166 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfca401-1307-41a9-89e8-72e5a02bbf99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:08.788829 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfca401-1307-41a9-89e8-72e5a02bbf99 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:08.789130 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfca401-1307-41a9-89e8-72e5a02bbf99 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:08.789403 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfca401-1307-41a9-89e8-72e5a02bbf99 None admin] PATH_INFO: `/v3/domains` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:08.790102 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfca401-1307-41a9-89e8-72e5a02bbf99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:08.790406 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfca401-1307-41a9-89e8-72e5a02bbf99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:08.791749 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfca401-1307-41a9-89e8-72e5a02bbf99 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:08.803663 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 308/618] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:35:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:08.804666 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfca401-1307-41a9-89e8-72e5a02bbf99 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:08.814970 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:08.830987 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc928558-551d-447d-8d48-c1011d86911c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:08.832428 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc928558-551d-447d-8d48-c1011d86911c None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:08.902821 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfca401-1307-41a9-89e8-72e5a02bbf99 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:08.928389 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:08.933460 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 311/619] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 13 23:35:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 23:35:08.933460 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc928558-551d-447d-8d48-c1011d86911c None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:08.936335 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d9173-9e12-44a8-87e3-9b3c6fbc921c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:08.937016 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d9173-9e12-44a8-87e3-9b3c6fbc921c None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:08.937426 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d9173-9e12-44a8-87e3-9b3c6fbc921c None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:08.937902 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d9173-9e12-44a8-87e3-9b3c6fbc921c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:09.003839 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901d9173-9e12-44a8-87e3-9b3c6fbc921c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:09.005390 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901d9173-9e12-44a8-87e3-9b3c6fbc921c None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:09.012985 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:09.028633 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc928558-551d-447d-8d48-c1011d86911c None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:09.062908 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0706f3-4c0f-4838-9a83-c4a1ebc90d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:09.063545 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0706f3-4c0f-4838-9a83-c4a1ebc90d6f None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:09.063834 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0706f3-4c0f-4838-9a83-c4a1ebc90d6f None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:09.064109 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0706f3-4c0f-4838-9a83-c4a1ebc90d6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:09.064981 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0706f3-4c0f-4838-9a83-c4a1ebc90d6f None admin] RBAC: Adding query filter params (role.id=3f7019b9af764b4089ae3cd30e8e2fb9, scope.project.id=11b8489ad08d40bc8f19a6ffa01c6897, user.id=a7e276c4bd434c028274e059a73c4060) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:09.065294 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0706f3-4c0f-4838-9a83-c4a1ebc90d6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:09.066703 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0706f3-4c0f-4838-9a83-c4a1ebc90d6f None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:09.072385 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 312/620] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 13 23:35:08 2022] GET /identity/v3/role_assignments?user.id=a7e276c4bd434c028274e059a73c4060&scope.project.id=11b8489ad08d40bc8f19a6ffa01c6897&role.id=3f7019b9af764b4089ae3cd30e8e2fb9 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:09.076756 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0706f3-4c0f-4838-9a83-c4a1ebc90d6f None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:09.107087 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 309/621] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 13 23:35:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 23:35:09.107948 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d9173-9e12-44a8-87e3-9b3c6fbc921c None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:09.142945 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:09.193902 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0706f3-4c0f-4838-9a83-c4a1ebc90d6f None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:09.227219 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d9173-9e12-44a8-87e3-9b3c6fbc921c None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:09.231797 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16790d-1d29-4349-acda-d6860ba25eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:09.232612 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16790d-1d29-4349-acda-d6860ba25eec None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:09.232997 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16790d-1d29-4349-acda-d6860ba25eec None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:09.233276 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16790d-1d29-4349-acda-d6860ba25eec None admin] PATH_INFO: `/v3/users/neutron` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:09.241646 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e16790d-1d29-4349-acda-d6860ba25eec None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:09.243102 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e16790d-1d29-4349-acda-d6860ba25eec None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:09.260855 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-5e16790d-1d29-4349-acda-d6860ba25eec None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 13 23:35:09.260855 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:09.260855 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:09.260855 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:09.260855 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:09.260855 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:09.260855 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:09.260855 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:09.260855 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:09.260855 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:09.260855 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:09.260855 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:09.260855 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 23:35:09.260855 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 23:35:09.260855 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 23:35:09.260855 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 23:35:09.261798 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:09.261798 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:09.261798 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 23:35:09.261798 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 23:35:09.261798 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 23:35:09.261798 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 23:35:09.261798 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:09.261798 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:09.261798 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:09.261798 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:09.261798 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:09.261798 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:09.261798 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:09.261798 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:09.261798 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:09.261798 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:09.261798 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:09.261798 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:09.263157 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:09.263157 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:09.263157 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 23:35:09.263157 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 23:35:09.263157 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 23:35:09.263157 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 23:35:09.263157 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 23:35:09.263157 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 23:35:09.263157 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 13 23:35:09.263157 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:09.263157 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 313/622] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jul 13 23:35:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:09.263761 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16790d-1d29-4349-acda-d6860ba25eec None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:09.271934 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0848cc-31fb-4993-8696-b5123804836f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:09.273449 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0848cc-31fb-4993-8696-b5123804836f None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:09.273889 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0848cc-31fb-4993-8696-b5123804836f None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:09.274315 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0848cc-31fb-4993-8696-b5123804836f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:09.274675 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:09.287018 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0848cc-31fb-4993-8696-b5123804836f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:09.288533 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0848cc-31fb-4993-8696-b5123804836f None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:09.308684 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-9b0848cc-31fb-4993-8696-b5123804836f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:35:09.308684 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:09.308684 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:09.308684 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:09.308684 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:09.308684 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:09.308684 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:09.308684 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:09.308684 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:09.308684 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:09.308684 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:09.308684 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:09.308684 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:35:09.308684 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:35:09.308684 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:35:09.309624 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:35:09.309624 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:09.309624 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:09.309624 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:09.309624 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:09.309624 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:09.309624 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:09.309624 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:09.309624 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:09.309624 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:09.309624 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:09.309624 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:09.309624 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:09.309624 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:09.309624 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:09.309624 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:09.309624 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:09.310505 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:35:09.310505 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:35:09.310505 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:35:09.310505 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:09.310505 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 310/623] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:35:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:09.310809 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0848cc-31fb-4993-8696-b5123804836f None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:09.379630 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16790d-1d29-4349-acda-d6860ba25eec None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:09.400908 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:09.418161 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6829cae-f170-4628-adc5-0af046d6badb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:09.418951 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6829cae-f170-4628-adc5-0af046d6badb None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:09.419237 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6829cae-f170-4628-adc5-0af046d6badb None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:09.419513 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6829cae-f170-4628-adc5-0af046d6badb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:09.420705 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0848cc-31fb-4993-8696-b5123804836f None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:09.430613 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6829cae-f170-4628-adc5-0af046d6badb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:09.433053 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6829cae-f170-4628-adc5-0af046d6badb None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:09.451269 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-c6829cae-f170-4628-adc5-0af046d6badb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:35:09.451269 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:09.451269 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:09.451269 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:09.451269 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:09.451269 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:09.451269 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:09.451269 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:09.451269 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:09.451269 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:09.451269 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:09.451269 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:09.451269 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:35:09.451269 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:35:09.451269 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:35:09.452161 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:35:09.452161 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:09.452161 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:09.452161 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:09.452161 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:09.452161 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:09.452161 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:09.452161 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:09.452161 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:09.452161 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:09.452161 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:09.452161 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:09.452161 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:09.452161 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:09.452161 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:09.452161 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:09.452161 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:09.453584 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:35:09.453584 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:35:09.453584 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:35:09.453584 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:09.453584 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 314/624] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:35:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:09.453584 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6829cae-f170-4628-adc5-0af046d6badb None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:09.466392 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76cbe32-cb62-4cb9-bda1-47180686a9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:09.467063 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cbe32-cb62-4cb9-bda1-47180686a9be None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:09.467348 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cbe32-cb62-4cb9-bda1-47180686a9be None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:09.467806 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cbe32-cb62-4cb9-bda1-47180686a9be None admin] PATH_INFO: `/v3/users` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:09.468448 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76cbe32-cb62-4cb9-bda1-47180686a9be None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:09.468792 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76cbe32-cb62-4cb9-bda1-47180686a9be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:09.470217 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76cbe32-cb62-4cb9-bda1-47180686a9be None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:09.493027 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 311/625] 10.222.0.16 () {56 vars in 1139 bytes} [Wed Jul 13 23:35:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:09.493027 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76cbe32-cb62-4cb9-bda1-47180686a9be None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:09.520566 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:09.567761 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6829cae-f170-4628-adc5-0af046d6badb None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:09.605632 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76cbe32-cb62-4cb9-bda1-47180686a9be None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:09.609315 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705d430-269d-4c32-8308-92d6afe05fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:09.609985 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705d430-269d-4c32-8308-92d6afe05fa8 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:09.610272 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705d430-269d-4c32-8308-92d6afe05fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:09.610552 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705d430-269d-4c32-8308-92d6afe05fa8 None admin] PATH_INFO: `/v3/domains` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:09.611275 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7705d430-269d-4c32-8308-92d6afe05fa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:09.611585 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7705d430-269d-4c32-8308-92d6afe05fa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:09.612984 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7705d430-269d-4c32-8308-92d6afe05fa8 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:09.629097 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 315/626] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:35:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:09.629097 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705d430-269d-4c32-8308-92d6afe05fa8 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:09.646067 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc956d2-1ee3-4fec-b99b-30981826299b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:09.646808 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc956d2-1ee3-4fec-b99b-30981826299b None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:09.647191 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc956d2-1ee3-4fec-b99b-30981826299b None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:09.647383 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc956d2-1ee3-4fec-b99b-30981826299b None admin] PATH_INFO: `/v3/domains` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:09.648088 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc956d2-1ee3-4fec-b99b-30981826299b None admin] RBAC: Adding query filter params (name=Default) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:09.648395 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc956d2-1ee3-4fec-b99b-30981826299b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:09.650037 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc956d2-1ee3-4fec-b99b-30981826299b None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:09.658382 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:09.669618 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 312/627] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:35:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:09.670390 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc956d2-1ee3-4fec-b99b-30981826299b None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:09.740000 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705d430-269d-4c32-8308-92d6afe05fa8 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:09.762944 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:09.777287 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa9c45-6c35-4911-a137-8b609b0c8682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:09.777884 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa9c45-6c35-4911-a137-8b609b0c8682 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:09.778174 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa9c45-6c35-4911-a137-8b609b0c8682 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:09.778455 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa9c45-6c35-4911-a137-8b609b0c8682 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:09.783341 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc956d2-1ee3-4fec-b99b-30981826299b None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:09.821194 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d710f5a-c1be-43f7-ad3d-92319ce2e2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:09.822113 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d710f5a-c1be-43f7-ad3d-92319ce2e2de None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:09.822400 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d710f5a-c1be-43f7-ad3d-92319ce2e2de None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:09.822674 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d710f5a-c1be-43f7-ad3d-92319ce2e2de None admin] PATH_INFO: `/v3/projects/service` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:09.831021 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d710f5a-c1be-43f7-ad3d-92319ce2e2de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:09.832460 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d710f5a-c1be-43f7-ad3d-92319ce2e2de None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:09.847549 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-5d710f5a-c1be-43f7-ad3d-92319ce2e2de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 23:35:09.847549 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:09.847549 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:09.847549 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:09.847549 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:09.847549 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:09.847549 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:09.847549 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:09.847549 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:09.847549 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:09.847549 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:09.847549 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:09.847549 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 23:35:09.847549 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 23:35:09.847549 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 23:35:09.848517 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 23:35:09.848517 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:09.848517 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:09.848517 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:09.848517 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:09.848517 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:09.848517 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:09.848517 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:09.848517 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:09.848517 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:09.848517 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:09.848517 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:09.848517 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:09.848517 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:09.848517 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:09.848517 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:09.848517 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:09.854211 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 23:35:09.854211 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 23:35:09.854211 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 23:35:09.854211 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 23:35:09.854211 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 23:35:09.854211 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 23:35:09.854211 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 23:35:09.854211 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:09.854211 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 313/628] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 13 23:35:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:09.854211 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d710f5a-c1be-43f7-ad3d-92319ce2e2de None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:09.860480 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa9c45-6c35-4911-a137-8b609b0c8682 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:09.862015 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa9c45-6c35-4911-a137-8b609b0c8682 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:09.922749 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:09.975749 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d710f5a-c1be-43f7-ad3d-92319ce2e2de None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:09.980872 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 316/629] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 13 23:35:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 23:35:09.980872 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa9c45-6c35-4911-a137-8b609b0c8682 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:10.002761 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:10.019453 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e79d6-debc-47bf-b99c-99eaa83ad6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:10.019942 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e79d6-debc-47bf-b99c-99eaa83ad6e6 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:10.020224 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e79d6-debc-47bf-b99c-99eaa83ad6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:10.020498 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e79d6-debc-47bf-b99c-99eaa83ad6e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:10.028579 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e79d6-debc-47bf-b99c-99eaa83ad6e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:10.030097 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e79d6-debc-47bf-b99c-99eaa83ad6e6 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:10.044596 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-a64e79d6-debc-47bf-b99c-99eaa83ad6e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 23:35:10.044596 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:10.044596 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:10.044596 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:10.044596 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:10.044596 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:10.044596 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:10.044596 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:10.044596 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:10.044596 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:10.044596 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:10.044596 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:10.044596 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 23:35:10.044596 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 23:35:10.044596 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 23:35:10.045533 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 23:35:10.045533 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:10.045533 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:10.045533 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:10.045533 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:10.045533 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:10.045533 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:10.045533 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:10.045533 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:10.045533 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:10.045533 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:10.045533 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:10.045533 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:10.045533 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:10.045533 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:10.045533 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:10.045533 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:10.046422 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 23:35:10.046422 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 23:35:10.046422 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 23:35:10.046422 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 23:35:10.046422 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 23:35:10.046422 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 23:35:10.046422 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 23:35:10.046422 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:10.046422 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 314/630] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 13 23:35:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:10.047609 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e79d6-debc-47bf-b99c-99eaa83ad6e6 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:10.091792 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa9c45-6c35-4911-a137-8b609b0c8682 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:10.130312 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd00b8-5459-40e3-a895-fac80ffca7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:10.130968 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd00b8-5459-40e3-a895-fac80ffca7f0 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:10.131249 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd00b8-5459-40e3-a895-fac80ffca7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:10.131530 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd00b8-5459-40e3-a895-fac80ffca7f0 None admin] PATH_INFO: `/v3/projects` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:10.132305 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd00b8-5459-40e3-a895-fac80ffca7f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:10.132612 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd00b8-5459-40e3-a895-fac80ffca7f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:10.134106 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd00b8-5459-40e3-a895-fac80ffca7f0 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:10.147284 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 317/631] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 13 23:35:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:10.148092 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd00b8-5459-40e3-a895-fac80ffca7f0 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:10.164151 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e79d6-debc-47bf-b99c-99eaa83ad6e6 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:10.181865 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:10.200082 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172f990-0e11-4cc4-8bfb-5c1bfce4f1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:10.200897 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172f990-0e11-4cc4-8bfb-5c1bfce4f1e7 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:10.201193 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172f990-0e11-4cc4-8bfb-5c1bfce4f1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:10.201457 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172f990-0e11-4cc4-8bfb-5c1bfce4f1e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:10.212771 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172f990-0e11-4cc4-8bfb-5c1bfce4f1e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:10.215017 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172f990-0e11-4cc4-8bfb-5c1bfce4f1e7 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:10.233800 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-2172f990-0e11-4cc4-8bfb-5c1bfce4f1e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:35:10.233800 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:10.233800 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:10.233800 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:10.233800 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:10.233800 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:10.233800 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:10.233800 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:10.233800 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:10.233800 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:10.233800 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:10.233800 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:10.233800 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:35:10.233800 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:35:10.233800 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:35:10.234743 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:35:10.234743 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:10.234743 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:10.234743 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:10.234743 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:10.234743 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:10.234743 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:10.234743 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:10.234743 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:10.234743 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:10.234743 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:10.234743 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:10.234743 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:10.234743 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:10.234743 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:10.234743 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:10.234743 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:10.235618 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:35:10.235618 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:35:10.235618 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:35:10.235618 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:10.236335 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:10.236429 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 315/632] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:35:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:10.236799 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172f990-0e11-4cc4-8bfb-5c1bfce4f1e7 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:10.260248 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd00b8-5459-40e3-a895-fac80ffca7f0 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:10.297553 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba175a7-84e5-4821-808f-85bf1ca7f24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:10.298132 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba175a7-84e5-4821-808f-85bf1ca7f24e None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:10.298416 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba175a7-84e5-4821-808f-85bf1ca7f24e None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:10.298692 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba175a7-84e5-4821-808f-85bf1ca7f24e None admin] PATH_INFO: `/v3/projects` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:10.299476 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba175a7-84e5-4821-808f-85bf1ca7f24e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:10.299784 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba175a7-84e5-4821-808f-85bf1ca7f24e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:10.301276 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba175a7-84e5-4821-808f-85bf1ca7f24e None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:10.319607 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 318/633] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 13 23:35:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:10.319607 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba175a7-84e5-4821-808f-85bf1ca7f24e None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:10.347173 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172f990-0e11-4cc4-8bfb-5c1bfce4f1e7 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:10.384107 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaafaf0-81ce-446d-9a2c-91dfe92bc241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:10.385102 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaafaf0-81ce-446d-9a2c-91dfe92bc241 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:10.385364 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaafaf0-81ce-446d-9a2c-91dfe92bc241 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:10.386207 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaafaf0-81ce-446d-9a2c-91dfe92bc241 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:10.387135 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaafaf0-81ce-446d-9a2c-91dfe92bc241 None admin] RBAC: Adding query filter params (role.id=3f7019b9af764b4089ae3cd30e8e2fb9, scope.project.id=11b8489ad08d40bc8f19a6ffa01c6897, user.id=15cdeb3131bc419f98ab11aaa4562d19) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:10.387699 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaafaf0-81ce-446d-9a2c-91dfe92bc241 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:10.389181 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaafaf0-81ce-446d-9a2c-91dfe92bc241 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:10.404850 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 316/634] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 13 23:35:10 2022] GET /identity/v3/role_assignments?user.id=15cdeb3131bc419f98ab11aaa4562d19&scope.project.id=11b8489ad08d40bc8f19a6ffa01c6897&role.id=3f7019b9af764b4089ae3cd30e8e2fb9 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:10.404850 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaafaf0-81ce-446d-9a2c-91dfe92bc241 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:10.438627 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba175a7-84e5-4821-808f-85bf1ca7f24e None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:10.448685 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:10.492047 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a4a7f-cea0-41b8-822e-eeb4bda6b338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:10.493150 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a4a7f-cea0-41b8-822e-eeb4bda6b338 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:10.493642 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a4a7f-cea0-41b8-822e-eeb4bda6b338 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:10.494123 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a4a7f-cea0-41b8-822e-eeb4bda6b338 None admin] PATH_INFO: `/v3/domains` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:10.495895 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a4a7f-cea0-41b8-822e-eeb4bda6b338 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:10.496495 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a4a7f-cea0-41b8-822e-eeb4bda6b338 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:10.498791 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a4a7f-cea0-41b8-822e-eeb4bda6b338 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:10.513060 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:10.524017 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 319/635] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:35:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:10.525099 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a4a7f-cea0-41b8-822e-eeb4bda6b338 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:10.541388 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaafaf0-81ce-446d-9a2c-91dfe92bc241 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:10.600881 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613686d7-afe6-4cb4-a662-a3ea6f76acad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:10.601437 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613686d7-afe6-4cb4-a662-a3ea6f76acad None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:10.601725 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613686d7-afe6-4cb4-a662-a3ea6f76acad None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:10.602004 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613686d7-afe6-4cb4-a662-a3ea6f76acad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:10.602831 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613686d7-afe6-4cb4-a662-a3ea6f76acad None admin] RBAC: Adding query filter params (role.id=3f7019b9af764b4089ae3cd30e8e2fb9, scope.project.id=11b8489ad08d40bc8f19a6ffa01c6897, user.id=ce654da79295477792be5ddb6e60ff12) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:10.603143 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613686d7-afe6-4cb4-a662-a3ea6f76acad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:10.605268 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613686d7-afe6-4cb4-a662-a3ea6f76acad None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:10.612013 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 317/636] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 13 23:35:10 2022] GET /identity/v3/role_assignments?user.id=ce654da79295477792be5ddb6e60ff12&scope.project.id=11b8489ad08d40bc8f19a6ffa01c6897&role.id=3f7019b9af764b4089ae3cd30e8e2fb9 => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:10.654230 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a4a7f-cea0-41b8-822e-eeb4bda6b338 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:10.698092 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d9f51-ace4-4ad9-9994-a7e6b8a85016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:10.699247 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d9f51-ace4-4ad9-9994-a7e6b8a85016 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:10.699537 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d9f51-ace4-4ad9-9994-a7e6b8a85016 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:10.699818 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d9f51-ace4-4ad9-9994-a7e6b8a85016 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:10.707785 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d9f51-ace4-4ad9-9994-a7e6b8a85016 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:10.709321 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d9f51-ace4-4ad9-9994-a7e6b8a85016 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:10.727121 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-3e8d9f51-ace4-4ad9-9994-a7e6b8a85016 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 23:35:10.727121 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:10.727121 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:10.727121 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:10.727121 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:10.727121 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:10.727121 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:10.727121 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:10.727121 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:10.727121 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:10.727121 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:10.727121 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:10.727121 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 23:35:10.727121 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 23:35:10.727121 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 23:35:10.728072 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 23:35:10.728072 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:10.728072 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:10.728072 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:10.728072 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:10.728072 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:10.728072 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:10.728072 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:10.728072 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:10.728072 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:10.728072 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:10.728072 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:10.728072 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:10.728072 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:10.728072 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:10.728072 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:10.728072 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:10.729048 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 23:35:10.729048 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 23:35:10.729048 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 23:35:10.729048 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 23:35:10.729048 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 23:35:10.729048 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 23:35:10.729048 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 23:35:10.729048 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:10.729048 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 320/637] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 13 23:35:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:10.734865 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613686d7-afe6-4cb4-a662-a3ea6f76acad None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:10.843356 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:10.847252 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613686d7-afe6-4cb4-a662-a3ea6f76acad None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:10.884154 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e584b-1088-4c7d-a369-9186468c52b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:10.884733 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e584b-1088-4c7d-a369-9186468c52b4 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:10.885038 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e584b-1088-4c7d-a369-9186468c52b4 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:10.885312 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e584b-1088-4c7d-a369-9186468c52b4 None admin] PATH_INFO: `/v3/projects` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:10.886559 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e584b-1088-4c7d-a369-9186468c52b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:10.886865 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e584b-1088-4c7d-a369-9186468c52b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:10.888587 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e584b-1088-4c7d-a369-9186468c52b4 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:10.903442 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 318/638] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 13 23:35:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:10.908731 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d9f51-ace4-4ad9-9994-a7e6b8a85016 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:10.973190 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:11.021597 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d9f51-ace4-4ad9-9994-a7e6b8a85016 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:11.059508 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184aa8fb-9219-4e4b-a117-821fb4009e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:11.060415 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184aa8fb-9219-4e4b-a117-821fb4009e2f None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:11.060893 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184aa8fb-9219-4e4b-a117-821fb4009e2f None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:11.061315 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184aa8fb-9219-4e4b-a117-821fb4009e2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:11.062313 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184aa8fb-9219-4e4b-a117-821fb4009e2f None admin] RBAC: Adding query filter params (role.id=3f7019b9af764b4089ae3cd30e8e2fb9, scope.project.id=11b8489ad08d40bc8f19a6ffa01c6897, user.id=05f1ce71ea7c4301ae0bfc84a06c9c38) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:11.062773 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184aa8fb-9219-4e4b-a117-821fb4009e2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:11.064375 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184aa8fb-9219-4e4b-a117-821fb4009e2f None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:11.071358 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 321/639] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 13 23:35:10 2022] GET /identity/v3/role_assignments?user.id=05f1ce71ea7c4301ae0bfc84a06c9c38&scope.project.id=11b8489ad08d40bc8f19a6ffa01c6897&role.id=3f7019b9af764b4089ae3cd30e8e2fb9 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:11.452177 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10b88c-5efb-4561-8708-dab5be0be9b5 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:11.452487 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10b88c-5efb-4561-8708-dab5be0be9b5 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:11.452719 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10b88c-5efb-4561-8708-dab5be0be9b5 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:11.454372 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 319/640] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:35:11.459511 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138978f-44d8-4db0-8994-fb0fea63f7e2 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:11.459807 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138978f-44d8-4db0-8994-fb0fea63f7e2 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:11.460088 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138978f-44d8-4db0-8994-fb0fea63f7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:11.478375 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-b138978f-44d8-4db0-8994-fb0fea63f7e2 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:35:11.480181 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-b138978f-44d8-4db0-8994-fb0fea63f7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:35:11.554879 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 322/641] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:35:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:35:11.579222 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b10b88c-5efb-4561-8708-dab5be0be9b5 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:11.688752 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b10b88c-5efb-4561-8708-dab5be0be9b5 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:11.726712 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4c37d-c006-4666-937e-c3c80c99c455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:11.727737 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4c37d-c006-4666-937e-c3c80c99c455 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:11.728171 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4c37d-c006-4666-937e-c3c80c99c455 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:11.728612 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4c37d-c006-4666-937e-c3c80c99c455 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:11.740561 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff4c37d-c006-4666-937e-c3c80c99c455 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:35:11.749178 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-4ff4c37d-c006-4666-937e-c3c80c99c455 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 23:35:11.749178 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:11.749178 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:11.749178 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:11.749178 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:11.749178 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:11.749178 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:11.749178 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:11.749178 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:11.749178 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:11.749178 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:11.749178 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:11.749178 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:35:11.749178 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:35:11.749178 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:35:11.749178 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:35:11.750404 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:35:11.750404 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:35:11.750404 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:35:11.750404 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:35:11.750404 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:11.750404 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:11.750404 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:11.750404 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:11.750404 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:11.750404 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:11.750404 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:11.750404 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:11.750404 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:11.750404 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:11.750404 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:11.750404 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:11.751522 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:11.751522 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:11.751522 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:11.751522 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:11.751522 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:35:11.751522 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:35:11.751522 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:35:11.751522 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:35:11.751522 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:35:11.751522 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:35:11.751522 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 23:35:11.751522 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:11.753986 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 320/642] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 13 23:35:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:11.759860 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138978f-44d8-4db0-8994-fb0fea63f7e2 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:11.821442 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:11.868586 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138978f-44d8-4db0-8994-fb0fea63f7e2 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:11.906204 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024bc57-3109-4ee6-bf95-619a8bbcc2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:11.906877 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024bc57-3109-4ee6-bf95-619a8bbcc2f0 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:11.907164 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024bc57-3109-4ee6-bf95-619a8bbcc2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:11.907444 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024bc57-3109-4ee6-bf95-619a8bbcc2f0 None admin] PATH_INFO: `/v3/roles` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:11.908190 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8024bc57-3109-4ee6-bf95-619a8bbcc2f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:11.908501 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8024bc57-3109-4ee6-bf95-619a8bbcc2f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:11.909917 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8024bc57-3109-4ee6-bf95-619a8bbcc2f0 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:11.919723 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 323/643] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:35:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:11.925182 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4c37d-c006-4666-937e-c3c80c99c455 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:11.953258 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:12.033842 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4c37d-c006-4666-937e-c3c80c99c455 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:12.068345 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df42f8-3e6b-46d1-914b-11b6d30c8e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:12.069461 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df42f8-3e6b-46d1-914b-11b6d30c8e88 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:12.070125 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df42f8-3e6b-46d1-914b-11b6d30c8e88 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:12.070610 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df42f8-3e6b-46d1-914b-11b6d30c8e88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:12.081576 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00df42f8-3e6b-46d1-914b-11b6d30c8e88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:12.083407 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00df42f8-3e6b-46d1-914b-11b6d30c8e88 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:12.101920 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-00df42f8-3e6b-46d1-914b-11b6d30c8e88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:35:12.101920 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:12.101920 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:12.101920 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:12.101920 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:12.101920 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:12.101920 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:12.101920 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:12.101920 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:12.101920 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:12.101920 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:12.101920 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:12.101920 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:35:12.101920 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:35:12.101920 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:35:12.102811 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:35:12.102811 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:12.102811 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:12.102811 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:12.102811 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:12.102811 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:12.102811 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:12.102811 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:12.102811 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:12.102811 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:12.102811 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:12.102811 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:12.102811 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:12.102811 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:12.102811 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:12.102811 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:12.102811 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:12.103690 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:35:12.103690 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:35:12.103690 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:35:12.103690 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:12.106016 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 321/644] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:35:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:12.111723 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024bc57-3109-4ee6-bf95-619a8bbcc2f0 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:12.219373 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024bc57-3109-4ee6-bf95-619a8bbcc2f0 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:12.236595 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:12.255632 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22688405-62c3-4c5f-900c-8e2b79e92ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:12.256286 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22688405-62c3-4c5f-900c-8e2b79e92ed7 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:12.256568 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22688405-62c3-4c5f-900c-8e2b79e92ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:12.256858 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22688405-62c3-4c5f-900c-8e2b79e92ed7 None admin] PATH_INFO: `/v3/domains` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:12.257577 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22688405-62c3-4c5f-900c-8e2b79e92ed7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:12.257878 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22688405-62c3-4c5f-900c-8e2b79e92ed7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:12.259238 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22688405-62c3-4c5f-900c-8e2b79e92ed7 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:12.272733 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 324/645] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:35:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:12.278815 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df42f8-3e6b-46d1-914b-11b6d30c8e88 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:12.354102 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:12.387872 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df42f8-3e6b-46d1-914b-11b6d30c8e88 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:12.425083 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1d1a5-a57b-4b90-94d1-68246de90795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:12.426233 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1d1a5-a57b-4b90-94d1-68246de90795 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:12.426733 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1d1a5-a57b-4b90-94d1-68246de90795 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:12.427211 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1d1a5-a57b-4b90-94d1-68246de90795 None admin] PATH_INFO: `/v3/users/nova` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:12.435592 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a1d1a5-a57b-4b90-94d1-68246de90795 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:12.437345 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a1d1a5-a57b-4b90-94d1-68246de90795 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:12.452639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-d5a1d1a5-a57b-4b90-94d1-68246de90795 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 23:35:12.452639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:12.452639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:12.452639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:12.452639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:12.452639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:12.452639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:12.452639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:12.452639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:12.452639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:12.452639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:12.452639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:12.452639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 23:35:12.452639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 23:35:12.452639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 23:35:12.452639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 23:35:12.453639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:12.453639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:12.453639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 23:35:12.453639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 23:35:12.453639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 23:35:12.453639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 23:35:12.453639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:12.453639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:12.453639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:12.453639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:12.453639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:12.453639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:12.453639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:12.453639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:12.453639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:12.453639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:12.453639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:12.453639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:12.454582 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:12.454582 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:12.454582 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 23:35:12.454582 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 23:35:12.454582 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 23:35:12.454582 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 23:35:12.454582 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 23:35:12.454582 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 23:35:12.454582 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 13 23:35:12.454582 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:12.457240 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 322/646] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jul 13 23:35:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:12.463659 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22688405-62c3-4c5f-900c-8e2b79e92ed7 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:12.579324 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22688405-62c3-4c5f-900c-8e2b79e92ed7 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:12.625611 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d0b1e-a076-4516-8117-da07143ceea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:12.626423 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d0b1e-a076-4516-8117-da07143ceea1 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:12.626707 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d0b1e-a076-4516-8117-da07143ceea1 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:12.626979 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d0b1e-a076-4516-8117-da07143ceea1 None admin] PATH_INFO: `/v3/users` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:12.627818 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d0b1e-a076-4516-8117-da07143ceea1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:12.628126 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d0b1e-a076-4516-8117-da07143ceea1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:12.629592 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d0b1e-a076-4516-8117-da07143ceea1 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:12.647734 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 325/647] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 13 23:35:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:12.653489 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1d1a5-a57b-4b90-94d1-68246de90795 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:12.766710 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1d1a5-a57b-4b90-94d1-68246de90795 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:12.798910 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:12.805386 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10bba89-ea77-4ff1-a2fe-531fd64a5b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:12.806315 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bba89-ea77-4ff1-a2fe-531fd64a5b05 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:12.806903 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bba89-ea77-4ff1-a2fe-531fd64a5b05 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:12.807965 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bba89-ea77-4ff1-a2fe-531fd64a5b05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:12.858395 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14fcf9-0504-4e5d-b64d-36300eed9424 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:12.858710 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14fcf9-0504-4e5d-b64d-36300eed9424 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:12.858950 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14fcf9-0504-4e5d-b64d-36300eed9424 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:12.864028 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 326/648] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:35:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:35:12.866083 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115816a-edd2-4f5e-92de-0b6fcfef1c17 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:12.866602 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115816a-edd2-4f5e-92de-0b6fcfef1c17 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:12.867146 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115816a-edd2-4f5e-92de-0b6fcfef1c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:12.881179 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10bba89-ea77-4ff1-a2fe-531fd64a5b05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:12.882576 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10bba89-ea77-4ff1-a2fe-531fd64a5b05 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:12.886125 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-f115816a-edd2-4f5e-92de-0b6fcfef1c17 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:35:12.888034 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-f115816a-edd2-4f5e-92de-0b6fcfef1c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:35:12.937373 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:12.984849 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 327/649] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:35:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:35:13.001042 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115816a-edd2-4f5e-92de-0b6fcfef1c17 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:13.020336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 323/650] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 13 23:35:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 23:35:13.026152 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10bba89-ea77-4ff1-a2fe-531fd64a5b05 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:13.063225 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:13.134410 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115816a-edd2-4f5e-92de-0b6fcfef1c17 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:13.148949 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10bba89-ea77-4ff1-a2fe-531fd64a5b05 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:13.172422 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fcffbd-bc05-49f2-8ee5-5f53f8f9e445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:13.173251 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fcffbd-bc05-49f2-8ee5-5f53f8f9e445 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:13.173544 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fcffbd-bc05-49f2-8ee5-5f53f8f9e445 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:13.173810 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fcffbd-bc05-49f2-8ee5-5f53f8f9e445 None admin] PATH_INFO: `/v3/services/image` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:13.174488 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fcffbd-bc05-49f2-8ee5-5f53f8f9e445 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:13.175859 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fcffbd-bc05-49f2-8ee5-5f53f8f9e445 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:13.186927 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050661b-11cd-43bd-b482-dd922e14e93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:13.187952 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050661b-11cd-43bd-b482-dd922e14e93b None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:13.188410 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050661b-11cd-43bd-b482-dd922e14e93b None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:13.188877 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050661b-11cd-43bd-b482-dd922e14e93b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:13.189348 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-c1fcffbd-bc05-49f2-8ee5-5f53f8f9e445 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 13 23:35:13.189348 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:13.189348 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 23:35:13.189348 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 23:35:13.189348 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 23:35:13.189348 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 23:35:13.189348 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 23:35:13.189348 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 23:35:13.189348 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 13 23:35:13.189348 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:13.189348 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 23:35:13.189348 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:13.189348 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:13.189348 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:13.189348 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:13.189348 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:13.189348 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:13.190312 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:13.190312 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:13.190312 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:13.190312 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:13.190312 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:13.190312 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:13.190312 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 23:35:13.190312 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 23:35:13.190312 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 23:35:13.190312 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 23:35:13.190312 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:13.190312 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:13.190312 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:13.190312 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:13.190312 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:13.190312 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:13.191163 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:13.191163 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:13.191163 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:13.191163 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:13.191163 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:13.191163 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:13.191163 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:13.191163 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:13.191163 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:13.191163 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:13.191163 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 23:35:13.191163 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 23:35:13.191163 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 13 23:35:13.191163 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:13.191163 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 328/651] 10.222.0.16 () {56 vars in 1105 bytes} [Wed Jul 13 23:35:12 2022] GET /identity/v3/services/image => generated 86 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 23:35:13.191955 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8d799-b9be-49b7-92e5-9f7c90d93e4d None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:13.192034 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8d799-b9be-49b7-92e5-9f7c90d93e4d None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:13.192470 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8d799-b9be-49b7-92e5-9f7c90d93e4d None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:13.197453 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 329/652] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:35:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:35:13.197453 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8d799-b9be-49b7-92e5-9f7c90d93e4d None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:13.206856 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6050661b-11cd-43bd-b482-dd922e14e93b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:13.208657 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6050661b-11cd-43bd-b482-dd922e14e93b None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:13.227018 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:13.227675 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-6050661b-11cd-43bd-b482-dd922e14e93b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:35:13.227675 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:13.227675 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:13.227675 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:13.227675 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:13.227675 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:13.227675 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:13.227675 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:13.227675 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:13.227675 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:13.227675 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:13.227675 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:13.227675 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:35:13.227675 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:35:13.227675 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:35:13.228558 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:35:13.228558 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:13.228558 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:13.228558 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:13.228558 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:13.228558 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:13.228558 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:13.228558 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:13.228558 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:13.228558 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:13.228558 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:13.228558 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:13.228558 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:13.228558 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:13.228558 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:13.228558 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:13.228558 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:13.230302 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:35:13.230302 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:35:13.230302 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:35:13.230302 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:13.230302 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 324/653] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:35:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 23:35:13.230987 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80deb1-2781-4861-a068-1848cf3ad0ca None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:13.231273 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80deb1-2781-4861-a068-1848cf3ad0ca None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:13.231547 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80deb1-2781-4861-a068-1848cf3ad0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:13.248296 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-1c80deb1-2781-4861-a068-1848cf3ad0ca None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:35:13.249512 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-1c80deb1-2781-4861-a068-1848cf3ad0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:35:13.329545 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8d799-b9be-49b7-92e5-9f7c90d93e4d None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:13.341275 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 325/654] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:35:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:35:13.341870 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80deb1-2781-4861-a068-1848cf3ad0ca None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:13.357300 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:13.369701 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584a086-5998-484c-84c0-cfa1a5c8199c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:13.370949 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584a086-5998-484c-84c0-cfa1a5c8199c None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:13.371238 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584a086-5998-484c-84c0-cfa1a5c8199c None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:13.371515 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584a086-5998-484c-84c0-cfa1a5c8199c None admin] PATH_INFO: `/v3/services` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:13.372219 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f584a086-5998-484c-84c0-cfa1a5c8199c None admin] RBAC: Adding query filter params (name=image) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:13.372535 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f584a086-5998-484c-84c0-cfa1a5c8199c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:13.373957 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f584a086-5998-484c-84c0-cfa1a5c8199c None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:13.378638 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 330/655] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:35:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:13.379424 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584a086-5998-484c-84c0-cfa1a5c8199c None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:13.459357 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80deb1-2781-4861-a068-1848cf3ad0ca None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:13.479501 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:13.488802 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584a086-5998-484c-84c0-cfa1a5c8199c None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:13.495419 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd9bbc-e3ec-4460-9cd5-1743d5d6d5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:13.496075 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd9bbc-e3ec-4460-9cd5-1743d5d6d5f9 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:13.496353 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd9bbc-e3ec-4460-9cd5-1743d5d6d5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:13.496623 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd9bbc-e3ec-4460-9cd5-1743d5d6d5f9 None admin] PATH_INFO: `/v3/domains` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:13.497377 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cd9bbc-e3ec-4460-9cd5-1743d5d6d5f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:13.497680 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cd9bbc-e3ec-4460-9cd5-1743d5d6d5f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:13.499035 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cd9bbc-e3ec-4460-9cd5-1743d5d6d5f9 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:13.510954 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 326/656] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:35:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:13.511801 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd9bbc-e3ec-4460-9cd5-1743d5d6d5f9 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:13.529373 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4889d11-f0be-4248-b592-1003af025ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:13.530188 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4889d11-f0be-4248-b592-1003af025ef7 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:13.530476 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4889d11-f0be-4248-b592-1003af025ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:13.530752 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4889d11-f0be-4248-b592-1003af025ef7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:13.531406 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4889d11-f0be-4248-b592-1003af025ef7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:13.532768 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4889d11-f0be-4248-b592-1003af025ef7 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:13.545395 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-d4889d11-f0be-4248-b592-1003af025ef7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 13 23:35:13.545395 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:13.545395 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 23:35:13.545395 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 23:35:13.545395 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 23:35:13.545395 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 23:35:13.545395 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 23:35:13.545395 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 23:35:13.545395 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 13 23:35:13.545395 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:13.545395 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 23:35:13.545395 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:13.545395 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:13.545395 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:13.545395 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:13.545395 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:13.546391 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:13.546391 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:13.546391 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:13.546391 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:13.546391 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:13.546391 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:13.546391 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:13.546391 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 23:35:13.546391 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 23:35:13.546391 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 23:35:13.546391 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 23:35:13.546391 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:13.546391 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:13.546391 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:13.546391 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:13.546391 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:13.547336 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:13.547336 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:13.547336 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:13.547336 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:13.547336 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:13.547336 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:13.547336 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:13.547336 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:13.547336 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:13.547336 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:13.547336 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:13.547336 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 23:35:13.547336 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 23:35:13.547336 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 13 23:35:13.547336 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:13.547336 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 331/657] 10.222.0.16 () {56 vars in 1129 bytes} [Wed Jul 13 23:35:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:13.552548 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b3947-f804-4d9f-815c-19a37e324d3c None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:13.552876 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b3947-f804-4d9f-815c-19a37e324d3c None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:13.553169 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b3947-f804-4d9f-815c-19a37e324d3c None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:13.554427 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 332/658] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:35:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:35:13.555123 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b3947-f804-4d9f-815c-19a37e324d3c None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:13.583079 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:13.614392 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd9bbc-e3ec-4460-9cd5-1743d5d6d5f9 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:13.648425 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f22e78-01fd-44ce-a1d5-e7840215496c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:13.649115 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f22e78-01fd-44ce-a1d5-e7840215496c None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:13.649398 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f22e78-01fd-44ce-a1d5-e7840215496c None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:13.649672 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f22e78-01fd-44ce-a1d5-e7840215496c None admin] PATH_INFO: `/v3/services` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:13.650360 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f22e78-01fd-44ce-a1d5-e7840215496c None admin] RBAC: Adding query filter params (type=image) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:13.650660 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f22e78-01fd-44ce-a1d5-e7840215496c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:13.652097 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f22e78-01fd-44ce-a1d5-e7840215496c None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:13.657512 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 327/659] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:35:13 2022] GET /identity/v3/services?type=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:13.658277 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f22e78-01fd-44ce-a1d5-e7840215496c None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:13.674040 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b3947-f804-4d9f-815c-19a37e324d3c None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:13.711415 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65eda4-0102-4df7-87a9-c5ea37165555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:13.712141 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65eda4-0102-4df7-87a9-c5ea37165555 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:13.712427 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65eda4-0102-4df7-87a9-c5ea37165555 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:13.712701 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65eda4-0102-4df7-87a9-c5ea37165555 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:13.722326 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c65eda4-0102-4df7-87a9-c5ea37165555 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:13.724192 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c65eda4-0102-4df7-87a9-c5ea37165555 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:13.746053 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-0c65eda4-0102-4df7-87a9-c5ea37165555 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 23:35:13.746053 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:13.746053 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:13.746053 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:13.746053 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:13.746053 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:13.746053 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:13.746053 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:13.746053 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:13.746053 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:13.746053 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:13.746053 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:13.746053 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 23:35:13.746053 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 23:35:13.746053 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 23:35:13.747045 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 23:35:13.747045 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:13.747045 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:13.747045 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:13.747045 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:13.747045 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:13.747045 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:13.747045 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:13.747045 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:13.747045 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:13.747045 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:13.747045 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:13.747045 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:13.747045 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:13.747045 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:13.747045 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:13.747045 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:13.747930 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 23:35:13.747930 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 23:35:13.747930 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 23:35:13.747930 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 23:35:13.747930 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 23:35:13.747930 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 23:35:13.747930 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 23:35:13.747930 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:13.747930 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 333/660] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 13 23:35:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:13.752938 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cde968-791f-4884-8442-b2bcfad39df9 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:13.752938 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cde968-791f-4884-8442-b2bcfad39df9 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:13.752938 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cde968-791f-4884-8442-b2bcfad39df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:13.776806 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-96cde968-791f-4884-8442-b2bcfad39df9 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:35:13.778063 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-96cde968-791f-4884-8442-b2bcfad39df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:35:13.778173 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f22e78-01fd-44ce-a1d5-e7840215496c None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:13.790354 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:13.829204 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c3d50-a7b8-498b-99e8-5c2b674fedd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:13.830196 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c3d50-a7b8-498b-99e8-5c2b674fedd8 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:13.830196 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c3d50-a7b8-498b-99e8-5c2b674fedd8 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:13.830569 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c3d50-a7b8-498b-99e8-5c2b674fedd8 None admin] PATH_INFO: `/v3/services` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:13.831653 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c3d50-a7b8-498b-99e8-5c2b674fedd8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:13.831970 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c3d50-a7b8-498b-99e8-5c2b674fedd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:13.833788 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c3d50-a7b8-498b-99e8-5c2b674fedd8 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:13.836420 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:13.840670 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 328/661] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jul 13 23:35:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:13.847317 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c3d50-a7b8-498b-99e8-5c2b674fedd8 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:13.854743 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 334/662] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:35:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:35:13.855594 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cde968-791f-4884-8442-b2bcfad39df9 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:13.958972 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c3d50-a7b8-498b-99e8-5c2b674fedd8 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:13.973045 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cde968-791f-4884-8442-b2bcfad39df9 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:13.996236 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff7ccc-8339-4ab9-848b-3df10ea415f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:13.996928 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff7ccc-8339-4ab9-848b-3df10ea415f8 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:13.997216 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff7ccc-8339-4ab9-848b-3df10ea415f8 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:13.997491 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff7ccc-8339-4ab9-848b-3df10ea415f8 None admin] PATH_INFO: `/v3/projects` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:13.998267 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff7ccc-8339-4ab9-848b-3df10ea415f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:13.998575 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff7ccc-8339-4ab9-848b-3df10ea415f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:14.000006 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff7ccc-8339-4ab9-848b-3df10ea415f8 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:14.008716 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdff3dd-1872-46b4-bcb8-ba5e3de2a789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:14.009416 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdff3dd-1872-46b4-bcb8-ba5e3de2a789 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:14.009700 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdff3dd-1872-46b4-bcb8-ba5e3de2a789 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:14.009981 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdff3dd-1872-46b4-bcb8-ba5e3de2a789 None admin] PATH_INFO: `/v3/services` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:14.011512 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdff3dd-1872-46b4-bcb8-ba5e3de2a789 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:14.011823 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdff3dd-1872-46b4-bcb8-ba5e3de2a789 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:14.013478 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 329/663] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 13 23:35:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:14.013586 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdff3dd-1872-46b4-bcb8-ba5e3de2a789 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:14.018162 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff7ccc-8339-4ab9-848b-3df10ea415f8 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:14.027662 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 335/664] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jul 13 23:35:13 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:14.029029 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdff3dd-1872-46b4-bcb8-ba5e3de2a789 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:14.045027 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:14.106351 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:14.155774 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdff3dd-1872-46b4-bcb8-ba5e3de2a789 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:14.177171 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff7ccc-8339-4ab9-848b-3df10ea415f8 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:14.211933 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb978fd-84e9-42cd-aa20-9496f2e67f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:14.211933 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb978fd-84e9-42cd-aa20-9496f2e67f42 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:14.211933 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb978fd-84e9-42cd-aa20-9496f2e67f42 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:14.212259 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb978fd-84e9-42cd-aa20-9496f2e67f42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:14.213105 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb978fd-84e9-42cd-aa20-9496f2e67f42 None admin] RBAC: Adding query filter params (role.id=46deff0e06964626a5600c9641454603, scope.project.id=11b8489ad08d40bc8f19a6ffa01c6897, user.id=a7e276c4bd434c028274e059a73c4060) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:14.213360 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb978fd-84e9-42cd-aa20-9496f2e67f42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:14.215427 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb978fd-84e9-42cd-aa20-9496f2e67f42 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:14.221689 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 336/665] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 13 23:35:14 2022] GET /identity/v3/role_assignments?user.id=a7e276c4bd434c028274e059a73c4060&scope.project.id=11b8489ad08d40bc8f19a6ffa01c6897&role.id=46deff0e06964626a5600c9641454603 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:14.224535 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44418af0-875f-4203-9244-ace7746525fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:14.225375 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44418af0-875f-4203-9244-ace7746525fb None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:14.225656 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44418af0-875f-4203-9244-ace7746525fb None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:14.225928 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44418af0-875f-4203-9244-ace7746525fb None admin] PATH_INFO: `/v3/services/network` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:14.226594 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44418af0-875f-4203-9244-ace7746525fb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:14.227990 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44418af0-875f-4203-9244-ace7746525fb None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:14.243435 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-44418af0-875f-4203-9244-ace7746525fb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 13 23:35:14.243435 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:14.243435 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 23:35:14.243435 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 23:35:14.243435 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 23:35:14.243435 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 23:35:14.243435 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 23:35:14.243435 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 23:35:14.243435 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 13 23:35:14.243435 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:14.243435 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 23:35:14.243435 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:14.243435 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:14.243435 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:14.243435 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:14.243435 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:14.243435 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:14.244511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:14.244511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:14.244511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:14.244511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:14.244511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:14.244511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:14.244511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 23:35:14.244511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 23:35:14.244511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 23:35:14.244511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 23:35:14.244511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:14.244511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:14.244511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:14.244511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:14.244511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:14.244511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:14.246073 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:14.246073 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:14.246073 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:14.246073 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:14.246073 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:14.246073 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:14.246073 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:14.246073 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:14.246073 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:14.246073 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:14.246073 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 23:35:14.246073 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 23:35:14.246073 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 13 23:35:14.246073 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:14.250382 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 330/666] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 13 23:35:14 2022] GET /identity/v3/services/network => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:14.251271 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb978fd-84e9-42cd-aa20-9496f2e67f42 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:14.339802 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:14.368877 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb978fd-84e9-42cd-aa20-9496f2e67f42 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:14.407859 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de41322-cb01-4731-8eae-ed983ee791f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:14.408527 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de41322-cb01-4731-8eae-ed983ee791f0 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:14.408810 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de41322-cb01-4731-8eae-ed983ee791f0 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:14.409116 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de41322-cb01-4731-8eae-ed983ee791f0 None admin] PATH_INFO: `/v3/services` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:14.409830 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de41322-cb01-4731-8eae-ed983ee791f0 None admin] RBAC: Adding query filter params (name=network) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:14.410197 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de41322-cb01-4731-8eae-ed983ee791f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:14.411595 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de41322-cb01-4731-8eae-ed983ee791f0 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:14.417386 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 337/667] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jul 13 23:35:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:14.423217 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44418af0-875f-4203-9244-ace7746525fb None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:14.535558 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44418af0-875f-4203-9244-ace7746525fb None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:14.561162 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:14.576919 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd4e25-5de9-417a-bac5-b9be68de6f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:14.577592 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd4e25-5de9-417a-bac5-b9be68de6f5b None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:14.577876 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd4e25-5de9-417a-bac5-b9be68de6f5b None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:14.578148 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd4e25-5de9-417a-bac5-b9be68de6f5b None admin] PATH_INFO: `/v3/services` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:14.578847 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd4e25-5de9-417a-bac5-b9be68de6f5b None admin] RBAC: Adding query filter params (type=network) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:14.579149 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd4e25-5de9-417a-bac5-b9be68de6f5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:14.580516 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd4e25-5de9-417a-bac5-b9be68de6f5b None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:14.585907 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 331/668] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jul 13 23:35:14 2022] GET /identity/v3/services?type=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:15.957828 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3be5f7-fac8-4eb2-9012-b0e92a324f19 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:15.958355 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3be5f7-fac8-4eb2-9012-b0e92a324f19 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:15.958355 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3be5f7-fac8-4eb2-9012-b0e92a324f19 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:15.959952 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 338/669] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:35:15.965852 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695b8de-f9c5-4d5a-91bc-02416bfe673b None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:15.966252 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695b8de-f9c5-4d5a-91bc-02416bfe673b None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:15.966424 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695b8de-f9c5-4d5a-91bc-02416bfe673b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:15.984577 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-1695b8de-f9c5-4d5a-91bc-02416bfe673b None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:35:15.985837 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-1695b8de-f9c5-4d5a-91bc-02416bfe673b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:35:16.055216 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 332/670] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:35:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 23:35:16.079755 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3be5f7-fac8-4eb2-9012-b0e92a324f19 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:16.189582 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3be5f7-fac8-4eb2-9012-b0e92a324f19 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:16.226998 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff023405-3fda-4ed5-8c44-9115f478bc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:16.227652 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff023405-3fda-4ed5-8c44-9115f478bc58 None admin] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:16.227940 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff023405-3fda-4ed5-8c44-9115f478bc58 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:16.228217 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff023405-3fda-4ed5-8c44-9115f478bc58 None admin] PATH_INFO: `/v3/services` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:16.229020 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff023405-3fda-4ed5-8c44-9115f478bc58 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:16.230445 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff023405-3fda-4ed5-8c44-9115f478bc58 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:16.248690 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:16.265469 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 339/671] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jul 13 23:35:16 2022] POST /identity/v3/services => generated 242 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 23:35:16.506595 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236cd3f-c38f-4108-93d7-764d1b6d7dd4 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:16.507605 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236cd3f-c38f-4108-93d7-764d1b6d7dd4 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:16.508386 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236cd3f-c38f-4108-93d7-764d1b6d7dd4 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:16.511969 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 333/672] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:35:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 23:35:16.521683 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ca3bf-2f84-41b4-9359-79531a70bb51 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:16.522476 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ca3bf-2f84-41b4-9359-79531a70bb51 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:16.523145 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ca3bf-2f84-41b4-9359-79531a70bb51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:16.555708 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-190ca3bf-2f84-41b4-9359-79531a70bb51 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:35:16.558954 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-190ca3bf-2f84-41b4-9359-79531a70bb51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:35:16.575011 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081383f-2226-4ba5-bc08-ed635dd53f7f None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:16.575910 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081383f-2226-4ba5-bc08-ed635dd53f7f None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:16.576815 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081383f-2226-4ba5-bc08-ed635dd53f7f None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:16.580075 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 334/673] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:35:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:35:16.586631 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7293152-9c80-428b-8412-dd73c8a7263d None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:16.586956 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7293152-9c80-428b-8412-dd73c8a7263d None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:16.587194 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7293152-9c80-428b-8412-dd73c8a7263d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:16.618389 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-f7293152-9c80-428b-8412-dd73c8a7263d None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:35:16.621772 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-f7293152-9c80-428b-8412-dd73c8a7263d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:35:16.664935 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 340/674] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:35:16 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 23:35:16.706953 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ca3bf-2f84-41b4-9359-79531a70bb51 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:16.708913 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 335/675] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:35:16 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 23:35:16.734214 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7293152-9c80-428b-8412-dd73c8a7263d None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:16.893100 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ca3bf-2f84-41b4-9359-79531a70bb51 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:16.928381 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:16.948605 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:16.971971 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824690c-c2c3-4d2f-9f20-67b32a795a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:16.974208 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824690c-c2c3-4d2f-9f20-67b32a795a63 None admin] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:16.974931 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824690c-c2c3-4d2f-9f20-67b32a795a63 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:16.975669 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824690c-c2c3-4d2f-9f20-67b32a795a63 None admin] PATH_INFO: `/v3/services` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:16.977415 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b824690c-c2c3-4d2f-9f20-67b32a795a63 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:16.980426 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b824690c-c2c3-4d2f-9f20-67b32a795a63 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:17.001359 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7293152-9c80-428b-8412-dd73c8a7263d None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:17.012771 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 341/676] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jul 13 23:35:16 2022] POST /identity/v3/services => generated 251 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 23:35:17.051662 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd29b6-c6b6-40f1-ac01-5eac08e111b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:17.052478 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd29b6-c6b6-40f1-ac01-5eac08e111b4 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:17.052761 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd29b6-c6b6-40f1-ac01-5eac08e111b4 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:17.053073 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd29b6-c6b6-40f1-ac01-5eac08e111b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:17.066438 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd29b6-c6b6-40f1-ac01-5eac08e111b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:35:17.076383 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-1cdd29b6-c6b6-40f1-ac01-5eac08e111b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 23:35:17.076383 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:17.076383 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:17.076383 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:17.076383 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:17.076383 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:17.076383 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:17.076383 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:17.076383 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:17.076383 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:17.076383 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:17.076383 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:17.076383 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:35:17.076383 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:35:17.076383 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:35:17.076383 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:35:17.078060 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:35:17.078060 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:35:17.078060 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:35:17.078060 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:35:17.078060 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:17.078060 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:17.078060 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:17.078060 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:17.078060 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:17.078060 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:17.078060 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:17.078060 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:17.078060 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:17.078060 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:17.078060 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:17.078060 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:17.079529 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:17.079529 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:17.079529 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:17.079529 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:17.079529 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:35:17.079529 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:35:17.079529 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:35:17.079529 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:35:17.079529 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:35:17.079529 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:35:17.079529 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 23:35:17.079529 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:17.079529 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 336/677] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 13 23:35:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 23:35:17.084426 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824690c-c2c3-4d2f-9f20-67b32a795a63 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:17.269917 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824690c-c2c3-4d2f-9f20-67b32a795a63 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:17.297232 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711fc98-da7c-4628-b72d-7cb7cb900c02 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:17.297657 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711fc98-da7c-4628-b72d-7cb7cb900c02 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:17.297907 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711fc98-da7c-4628-b72d-7cb7cb900c02 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:17.300120 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 337/678] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 23:35:17.305013 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08688893-a8e6-4d91-93f6-1a0ef8bffbb7 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:17.305546 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08688893-a8e6-4d91-93f6-1a0ef8bffbb7 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:17.306321 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08688893-a8e6-4d91-93f6-1a0ef8bffbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:17.310676 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4de8c2-dcdf-40bf-87c1-4c6961e39483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:17.311445 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4de8c2-dcdf-40bf-87c1-4c6961e39483 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:17.311734 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4de8c2-dcdf-40bf-87c1-4c6961e39483 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:17.312093 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4de8c2-dcdf-40bf-87c1-4c6961e39483 None admin] PATH_INFO: `/v3/roles` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:17.313226 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4de8c2-dcdf-40bf-87c1-4c6961e39483 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:17.313800 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4de8c2-dcdf-40bf-87c1-4c6961e39483 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:17.316665 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4de8c2-dcdf-40bf-87c1-4c6961e39483 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:17.327260 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-08688893-a8e6-4d91-93f6-1a0ef8bffbb7 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:35:17.328771 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-08688893-a8e6-4d91-93f6-1a0ef8bffbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:35:17.329351 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 342/679] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:35:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:17.334496 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4de8c2-dcdf-40bf-87c1-4c6961e39483 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:17.392478 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:17.420965 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 338/680] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:35:17 2022] POST /identity/v3/auth/tokens => generated 999 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 23:35:17.441108 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08688893-a8e6-4d91-93f6-1a0ef8bffbb7 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:17.468974 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4de8c2-dcdf-40bf-87c1-4c6961e39483 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:17.479845 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:17.511500 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733bdbf-022f-4d3f-8985-a48eba845606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:17.513061 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733bdbf-022f-4d3f-8985-a48eba845606 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:17.513552 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733bdbf-022f-4d3f-8985-a48eba845606 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:17.514043 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733bdbf-022f-4d3f-8985-a48eba845606 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:17.527293 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f733bdbf-022f-4d3f-8985-a48eba845606 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:17.529143 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f733bdbf-022f-4d3f-8985-a48eba845606 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:17.551135 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-f733bdbf-022f-4d3f-8985-a48eba845606 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:35:17.551135 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:17.551135 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:17.551135 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:17.551135 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:17.551135 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:17.551135 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:17.551135 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:17.551135 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:17.551135 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:17.551135 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:17.551135 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:17.551135 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:35:17.551135 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:35:17.551135 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:35:17.552064 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:35:17.552064 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:17.552064 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:17.552064 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:17.552064 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:17.552064 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:17.552064 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:17.552064 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:17.552064 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:17.552064 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:17.552064 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:17.552064 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:17.552064 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:17.552064 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:17.552064 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:17.552064 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:17.552064 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:17.553442 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:35:17.553442 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:35:17.553442 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:35:17.553442 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:17.555584 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 343/681] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:35:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 23:35:17.561555 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733bdbf-022f-4d3f-8985-a48eba845606 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:17.563165 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08688893-a8e6-4d91-93f6-1a0ef8bffbb7 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:17.620323 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8e8b1-7ae3-46cd-ac08-2e9b1aded3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:17.621087 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8e8b1-7ae3-46cd-ac08-2e9b1aded3c6 None admin] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:17.621374 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8e8b1-7ae3-46cd-ac08-2e9b1aded3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:17.621650 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8e8b1-7ae3-46cd-ac08-2e9b1aded3c6 None admin] PATH_INFO: `/v3/services` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:17.622376 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d8e8b1-7ae3-46cd-ac08-2e9b1aded3c6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:17.623745 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d8e8b1-7ae3-46cd-ac08-2e9b1aded3c6 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:17.648911 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 339/682] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jul 13 23:35:17 2022] POST /identity/v3/services => generated 240 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 23:35:17.694238 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:17.699886 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733bdbf-022f-4d3f-8985-a48eba845606 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:17.750898 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9ab22-ad05-4c29-830d-991fa1656cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:17.751948 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9ab22-ad05-4c29-830d-991fa1656cea None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:17.752434 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9ab22-ad05-4c29-830d-991fa1656cea None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:17.752962 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9ab22-ad05-4c29-830d-991fa1656cea None admin] PATH_INFO: `/v3/domains` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:17.753906 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d9ab22-ad05-4c29-830d-991fa1656cea None admin] RBAC: Adding query filter params (name=Default) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:17.754475 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d9ab22-ad05-4c29-830d-991fa1656cea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:17.756221 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d9ab22-ad05-4c29-830d-991fa1656cea None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:17.770306 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 344/683] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:35:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:17.776732 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8e8b1-7ae3-46cd-ac08-2e9b1aded3c6 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:17.879274 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:17.888764 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8e8b1-7ae3-46cd-ac08-2e9b1aded3c6 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:17.930633 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae2705-fce1-4004-afde-53b4e22c36b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:17.931769 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae2705-fce1-4004-afde-53b4e22c36b0 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:17.932915 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae2705-fce1-4004-afde-53b4e22c36b0 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:17.933441 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae2705-fce1-4004-afde-53b4e22c36b0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:17.941446 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae2705-fce1-4004-afde-53b4e22c36b0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:17.943137 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae2705-fce1-4004-afde-53b4e22c36b0 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:17.958781 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-a7ae2705-fce1-4004-afde-53b4e22c36b0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 23:35:17.958781 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:17.958781 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:17.958781 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:17.958781 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:17.958781 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:17.958781 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:17.958781 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:17.958781 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:17.958781 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:17.958781 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:17.958781 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:17.958781 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 23:35:17.958781 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 23:35:17.958781 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 23:35:17.958781 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 23:35:17.959979 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:17.959979 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:17.959979 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 23:35:17.959979 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 23:35:17.959979 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 23:35:17.959979 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 23:35:17.959979 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:17.959979 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:17.959979 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:17.959979 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:17.959979 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:17.959979 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:17.959979 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:17.959979 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:17.959979 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:17.959979 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:17.959979 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:17.959979 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:17.960948 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:17.960948 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:17.960948 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 23:35:17.960948 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 23:35:17.960948 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 23:35:17.960948 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 23:35:17.960948 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 23:35:17.960948 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 23:35:17.960948 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 13 23:35:17.960948 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:17.963461 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 340/684] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jul 13 23:35:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:17.972865 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9ab22-ad05-4c29-830d-991fa1656cea None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:18.076593 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9ab22-ad05-4c29-830d-991fa1656cea None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:18.111334 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1104e1d4-92dc-4b4c-afea-81c952191a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:18.112392 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104e1d4-92dc-4b4c-afea-81c952191a0a None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:18.112915 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104e1d4-92dc-4b4c-afea-81c952191a0a None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:18.113427 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104e1d4-92dc-4b4c-afea-81c952191a0a None admin] PATH_INFO: `/v3/users` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:18.114456 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1104e1d4-92dc-4b4c-afea-81c952191a0a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:18.114965 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1104e1d4-92dc-4b4c-afea-81c952191a0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:18.116587 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1104e1d4-92dc-4b4c-afea-81c952191a0a None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:18.135851 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 345/685] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 13 23:35:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:18.141371 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae2705-fce1-4004-afde-53b4e22c36b0 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:18.254919 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae2705-fce1-4004-afde-53b4e22c36b0 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:18.292506 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed36e7-7e30-4246-93a2-330acae91bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:18.293732 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed36e7-7e30-4246-93a2-330acae91bc6 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:18.294236 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed36e7-7e30-4246-93a2-330acae91bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:18.294728 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed36e7-7e30-4246-93a2-330acae91bc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:18.306282 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ed36e7-7e30-4246-93a2-330acae91bc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:18.308704 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ed36e7-7e30-4246-93a2-330acae91bc6 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:18.327487 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-d1ed36e7-7e30-4246-93a2-330acae91bc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:35:18.327487 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:18.327487 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:18.327487 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:18.327487 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:18.327487 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:18.327487 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:18.327487 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:18.327487 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:18.327487 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:18.327487 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:18.327487 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:18.327487 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:35:18.327487 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:35:18.327487 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:35:18.328398 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:35:18.328398 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:18.328398 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:18.328398 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:18.328398 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:18.328398 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:18.328398 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:18.328398 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:18.328398 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:18.328398 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:18.328398 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:18.328398 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:18.328398 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:18.328398 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:18.328398 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:18.328398 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:18.328398 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:18.329298 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:35:18.329298 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:35:18.329298 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:35:18.329298 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:18.331490 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 341/686] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:35:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:18.337927 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1104e1d4-92dc-4b4c-afea-81c952191a0a None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:18.353054 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:18.443058 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1104e1d4-92dc-4b4c-afea-81c952191a0a None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:18.479968 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab33fcf-7732-4f0c-82b2-1e03bd8c8dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:18.480951 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab33fcf-7732-4f0c-82b2-1e03bd8c8dd0 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:18.481385 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab33fcf-7732-4f0c-82b2-1e03bd8c8dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:18.481816 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab33fcf-7732-4f0c-82b2-1e03bd8c8dd0 None admin] PATH_INFO: `/v3/domains` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:18.482676 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab33fcf-7732-4f0c-82b2-1e03bd8c8dd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:18.483128 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab33fcf-7732-4f0c-82b2-1e03bd8c8dd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:18.484652 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab33fcf-7732-4f0c-82b2-1e03bd8c8dd0 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:18.500934 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 346/687] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:35:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:18.502995 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed36e7-7e30-4246-93a2-330acae91bc6 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:18.518270 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:18.624941 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed36e7-7e30-4246-93a2-330acae91bc6 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:18.659557 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4efa43a-fabc-49ae-9caf-c45bd315417b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:18.660352 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efa43a-fabc-49ae-9caf-c45bd315417b None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:18.660634 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efa43a-fabc-49ae-9caf-c45bd315417b None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:18.660938 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efa43a-fabc-49ae-9caf-c45bd315417b None admin] PATH_INFO: `/v3/projects/service` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:18.668390 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4efa43a-fabc-49ae-9caf-c45bd315417b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:18.669844 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4efa43a-fabc-49ae-9caf-c45bd315417b None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:18.684928 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-d4efa43a-fabc-49ae-9caf-c45bd315417b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 23:35:18.684928 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:18.684928 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:18.684928 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:18.684928 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:18.684928 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:18.684928 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:18.684928 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:18.684928 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:18.684928 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:18.684928 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:18.684928 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:18.684928 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 23:35:18.684928 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 23:35:18.684928 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 23:35:18.685830 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 23:35:18.685830 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:18.685830 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:18.685830 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:18.685830 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:18.685830 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:18.685830 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:18.685830 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:18.685830 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:18.685830 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:18.685830 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:18.685830 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:18.685830 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:18.685830 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:18.685830 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:18.685830 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:18.685830 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:18.686976 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 23:35:18.686976 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 23:35:18.686976 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 23:35:18.686976 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 23:35:18.686976 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 23:35:18.686976 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 23:35:18.686976 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 23:35:18.686976 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:18.686976 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 342/688] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 13 23:35:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:18.694003 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab33fcf-7732-4f0c-82b2-1e03bd8c8dd0 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:18.717733 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea9040-6b23-42a5-bc69-cb157374312a None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:18.718042 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea9040-6b23-42a5-bc69-cb157374312a None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:18.718284 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea9040-6b23-42a5-bc69-cb157374312a None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:18.719854 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 343/689] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:35:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:35:18.726372 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9233ac1-bf43-49c2-abbd-64568dbfb588 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:18.726705 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9233ac1-bf43-49c2-abbd-64568dbfb588 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:18.726979 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9233ac1-bf43-49c2-abbd-64568dbfb588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:18.746971 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-a9233ac1-bf43-49c2-abbd-64568dbfb588 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:35:18.748480 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-a9233ac1-bf43-49c2-abbd-64568dbfb588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:35:18.790741 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:18.822157 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:18.825543 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab33fcf-7732-4f0c-82b2-1e03bd8c8dd0 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:18.837356 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 344/690] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:35:18 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 23:35:18.859201 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9233ac1-bf43-49c2-abbd-64568dbfb588 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:18.870755 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b0400f-bd3b-4490-ae33-36f4776052a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:18.871943 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0400f-bd3b-4490-ae33-36f4776052a6 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:18.872430 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0400f-bd3b-4490-ae33-36f4776052a6 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:18.872945 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0400f-bd3b-4490-ae33-36f4776052a6 None admin] PATH_INFO: `/v3/projects` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:18.874000 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b0400f-bd3b-4490-ae33-36f4776052a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:18.874651 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b0400f-bd3b-4490-ae33-36f4776052a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:18.876433 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b0400f-bd3b-4490-ae33-36f4776052a6 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:18.897030 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 347/691] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 13 23:35:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:35:18.898848 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b0400f-bd3b-4490-ae33-36f4776052a6 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:18.969316 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9233ac1-bf43-49c2-abbd-64568dbfb588 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:19.014647 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b0400f-bd3b-4490-ae33-36f4776052a6 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:19.022189 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df38b68-a4ac-4153-92b2-d7f5c157d3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:19.022990 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df38b68-a4ac-4153-92b2-d7f5c157d3e4 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:19.023281 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df38b68-a4ac-4153-92b2-d7f5c157d3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:19.023571 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df38b68-a4ac-4153-92b2-d7f5c157d3e4 None admin] PATH_INFO: `/v3/services/image` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:19.024219 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df38b68-a4ac-4153-92b2-d7f5c157d3e4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:19.026504 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df38b68-a4ac-4153-92b2-d7f5c157d3e4 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:19.038511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-3df38b68-a4ac-4153-92b2-d7f5c157d3e4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 13 23:35:19.038511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:19.038511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 23:35:19.038511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 23:35:19.038511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 23:35:19.038511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 23:35:19.038511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 23:35:19.038511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 23:35:19.038511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 13 23:35:19.038511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:19.038511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 23:35:19.038511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:19.038511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:19.038511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:19.038511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:19.038511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:19.038511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:19.039751 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:19.039751 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:19.039751 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:19.039751 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:19.039751 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:19.039751 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:19.039751 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 23:35:19.039751 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 23:35:19.039751 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 23:35:19.039751 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 23:35:19.039751 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:19.039751 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:19.039751 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:19.039751 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:19.039751 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:19.039751 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:19.040941 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:19.040941 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:19.040941 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:19.040941 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:19.040941 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:19.040941 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:19.040941 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:19.040941 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:19.040941 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:19.040941 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:19.040941 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 23:35:19.040941 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 23:35:19.040941 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 13 23:35:19.040941 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:19.048600 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 345/692] 10.222.0.16 () {56 vars in 1105 bytes} [Wed Jul 13 23:35:18 2022] GET /identity/v3/services/image => generated 86 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:19.050408 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df38b68-a4ac-4153-92b2-d7f5c157d3e4 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:19.059935 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:19.066553 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f0533-191d-4626-b7e1-db3a779d4976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:19.068175 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f0533-191d-4626-b7e1-db3a779d4976 None admin] REQUEST_METHOD: `PUT` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:19.068584 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f0533-191d-4626-b7e1-db3a779d4976 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:19.068970 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f0533-191d-4626-b7e1-db3a779d4976 None admin] PATH_INFO: `/v3/projects/11b8489ad08d40bc8f19a6ffa01c6897/users/a7e276c4bd434c028274e059a73c4060/roles/46deff0e06964626a5600c9641454603` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:19.071746 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25f0533-191d-4626-b7e1-db3a779d4976 None admin] RBAC: Authorizing `identity:create_grant(project_id=11b8489ad08d40bc8f19a6ffa01c6897, user_id=a7e276c4bd434c028274e059a73c4060, role_id=46deff0e06964626a5600c9641454603)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:19.073540 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25f0533-191d-4626-b7e1-db3a779d4976 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:19.100852 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 348/693] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jul 13 23:35:18 2022] PUT /identity/v3/projects/11b8489ad08d40bc8f19a6ffa01c6897/users/a7e276c4bd434c028274e059a73c4060/roles/46deff0e06964626a5600c9641454603 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 23:35:19.133557 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:19.183836 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df38b68-a4ac-4153-92b2-d7f5c157d3e4 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:19.229888 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd80f1-2452-499c-a9b0-7a97584cd284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:19.230506 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd80f1-2452-499c-a9b0-7a97584cd284 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:19.230796 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd80f1-2452-499c-a9b0-7a97584cd284 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:19.231138 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd80f1-2452-499c-a9b0-7a97584cd284 None admin] PATH_INFO: `/v3/services` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:19.231884 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd80f1-2452-499c-a9b0-7a97584cd284 None admin] RBAC: Adding query filter params (name=image) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:19.232194 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd80f1-2452-499c-a9b0-7a97584cd284 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:19.233667 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd80f1-2452-499c-a9b0-7a97584cd284 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:19.239859 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 346/694] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:35:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:35:19.246817 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f0533-191d-4626-b7e1-db3a779d4976 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:19.364888 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f0533-191d-4626-b7e1-db3a779d4976 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:19.388065 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276e5a8-c060-4e8b-8012-b0088cf77de2 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:19.388477 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276e5a8-c060-4e8b-8012-b0088cf77de2 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:19.388893 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276e5a8-c060-4e8b-8012-b0088cf77de2 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:19.390577 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 347/695] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:35:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:35:19.395785 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f8cc5-1d46-4995-a829-6862bc54b50e None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:19.396183 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f8cc5-1d46-4995-a829-6862bc54b50e None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:19.396603 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f8cc5-1d46-4995-a829-6862bc54b50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:19.402443 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829315f-a2cb-48f2-be8c-cedf606ab8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:19.403112 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829315f-a2cb-48f2-be8c-cedf606ab8ed None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:19.403396 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829315f-a2cb-48f2-be8c-cedf606ab8ed None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:19.403673 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829315f-a2cb-48f2-be8c-cedf606ab8ed None admin] PATH_INFO: `/v3/services` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:19.404384 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e829315f-a2cb-48f2-be8c-cedf606ab8ed None admin] RBAC: Adding query filter params (type=image) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:19.404690 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e829315f-a2cb-48f2-be8c-cedf606ab8ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:19.406174 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e829315f-a2cb-48f2-be8c-cedf606ab8ed None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:19.411466 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 349/696] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:35:19 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:19.415725 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-8b4f8cc5-1d46-4995-a829-6862bc54b50e None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:35:19.417367 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-8b4f8cc5-1d46-4995-a829-6862bc54b50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:35:19.417739 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829315f-a2cb-48f2-be8c-cedf606ab8ed None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:19.500479 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 348/697] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:35:19 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 23:35:19.525670 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f8cc5-1d46-4995-a829-6862bc54b50e None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:19.596599 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:19.632280 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:19.647648 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f8cc5-1d46-4995-a829-6862bc54b50e None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:19.686759 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada6988-dbdb-4f9c-b29f-9cf4217162a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:19.687626 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada6988-dbdb-4f9c-b29f-9cf4217162a5 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:19.688062 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada6988-dbdb-4f9c-b29f-9cf4217162a5 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:19.688343 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada6988-dbdb-4f9c-b29f-9cf4217162a5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:19.689356 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada6988-dbdb-4f9c-b29f-9cf4217162a5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:19.691028 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada6988-dbdb-4f9c-b29f-9cf4217162a5 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:19.698099 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829315f-a2cb-48f2-be8c-cedf606ab8ed None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:19.707389 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-4ada6988-dbdb-4f9c-b29f-9cf4217162a5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 13 23:35:19.707389 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:19.707389 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 23:35:19.707389 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 23:35:19.707389 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 23:35:19.707389 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 23:35:19.707389 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 23:35:19.707389 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 23:35:19.707389 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 13 23:35:19.707389 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:19.707389 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 23:35:19.707389 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:19.707389 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:19.707389 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:19.707389 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:19.707389 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:19.708336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:19.708336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:19.708336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:19.708336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:19.708336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:19.708336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:19.708336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:19.708336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 23:35:19.708336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 23:35:19.708336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 23:35:19.708336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 23:35:19.708336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:19.708336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:19.708336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:19.708336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:19.708336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:19.709566 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:19.709566 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:19.709566 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:19.709566 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:19.709566 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:19.709566 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:19.709566 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:19.709566 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:19.709566 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:19.709566 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:19.709566 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:19.709566 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 23:35:19.709566 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 23:35:19.709566 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 13 23:35:19.709566 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:19.712955 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 349/698] 10.222.0.16 () {56 vars in 1129 bytes} [Wed Jul 13 23:35:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:19.715389 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada6988-dbdb-4f9c-b29f-9cf4217162a5 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:19.743282 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98751c1a-9778-4743-a710-da2d30131554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:19.743950 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98751c1a-9778-4743-a710-da2d30131554 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:19.744238 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98751c1a-9778-4743-a710-da2d30131554 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:19.744546 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98751c1a-9778-4743-a710-da2d30131554 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:19.746466 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98751c1a-9778-4743-a710-da2d30131554 None admin] RBAC: Adding query filter params (interface=public, service_id=2cbc9afcaf5142a7b0b0766205c4142c, region_id=RegionOne) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:19.746788 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98751c1a-9778-4743-a710-da2d30131554 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:19.748262 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98751c1a-9778-4743-a710-da2d30131554 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:19.756908 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 350/699] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Jul 13 23:35:19 2022] GET /identity/v3/endpoints?service_id=2cbc9afcaf5142a7b0b0766205c4142c&interface=public®ion_id=RegionOne => generated 194 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:35:19.762975 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98751c1a-9778-4743-a710-da2d30131554 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:19.837084 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada6988-dbdb-4f9c-b29f-9cf4217162a5 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:19.856147 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:19.869174 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98751c1a-9778-4743-a710-da2d30131554 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:19.875341 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb277c-b49e-4a2e-a084-cf2aeafd3e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:19.876223 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb277c-b49e-4a2e-a084-cf2aeafd3e82 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:19.876684 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb277c-b49e-4a2e-a084-cf2aeafd3e82 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:19.877126 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb277c-b49e-4a2e-a084-cf2aeafd3e82 None admin] PATH_INFO: `/v3/services` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:19.877999 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb277c-b49e-4a2e-a084-cf2aeafd3e82 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:19.878455 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb277c-b49e-4a2e-a084-cf2aeafd3e82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:19.880022 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb277c-b49e-4a2e-a084-cf2aeafd3e82 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:19.886568 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 350/700] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jul 13 23:35:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:35:19.893864 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb277c-b49e-4a2e-a084-cf2aeafd3e82 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:19.903253 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:19.925783 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d669a6e-63e4-485b-8944-a4f4e08afbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:19.926460 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d669a6e-63e4-485b-8944-a4f4e08afbf3 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:19.926746 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d669a6e-63e4-485b-8944-a4f4e08afbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:19.927024 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d669a6e-63e4-485b-8944-a4f4e08afbf3 None admin] PATH_INFO: `/v3/services` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:19.927710 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d669a6e-63e4-485b-8944-a4f4e08afbf3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:19.929723 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d669a6e-63e4-485b-8944-a4f4e08afbf3 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:19.944856 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 351/701] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jul 13 23:35:19 2022] GET /identity/v3/services => generated 1002 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 23:35:20.028146 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb277c-b49e-4a2e-a084-cf2aeafd3e82 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:20.064876 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff23be2-5c7e-4213-bf82-88eb2aec6e3a None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:20.064876 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff23be2-5c7e-4213-bf82-88eb2aec6e3a None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:20.064876 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff23be2-5c7e-4213-bf82-88eb2aec6e3a None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:20.065872 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 352/702] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 23:35:20.069351 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1909a-f204-44f6-af85-dcfedadceaad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:20.070331 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1909a-f204-44f6-af85-dcfedadceaad None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:20.070771 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1909a-f204-44f6-af85-dcfedadceaad None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:20.071199 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1909a-f204-44f6-af85-dcfedadceaad None admin] PATH_INFO: `/v3/services` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:20.071393 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3872d-35b8-4750-af7e-8847405f666f None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:20.071689 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3872d-35b8-4750-af7e-8847405f666f None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:20.071973 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3872d-35b8-4750-af7e-8847405f666f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:20.072527 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e1909a-f204-44f6-af85-dcfedadceaad None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:20.073738 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e1909a-f204-44f6-af85-dcfedadceaad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:20.075475 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e1909a-f204-44f6-af85-dcfedadceaad None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:20.082035 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 351/703] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jul 13 23:35:19 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:20.090192 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-b0b3872d-35b8-4750-af7e-8847405f666f None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:35:20.090387 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1909a-f204-44f6-af85-dcfedadceaad None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:20.091272 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-b0b3872d-35b8-4750-af7e-8847405f666f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:35:20.156773 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:20.181812 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 353/704] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:35:20 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 23:35:20.210871 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3872d-35b8-4750-af7e-8847405f666f None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:20.227221 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1909a-f204-44f6-af85-dcfedadceaad None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:20.269471 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9deb1f-4b94-4505-8f05-83375be7c29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:20.271170 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9deb1f-4b94-4505-8f05-83375be7c29c None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:20.271694 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9deb1f-4b94-4505-8f05-83375be7c29c None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:20.272195 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9deb1f-4b94-4505-8f05-83375be7c29c None admin] PATH_INFO: `/v3/endpoints` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:20.273354 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9deb1f-4b94-4505-8f05-83375be7c29c None admin] RBAC: Adding query filter params (interface=public, service_id=900761e2fb84419a9276ed65ff99c790, region_id=RegionOne) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:20.274227 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9deb1f-4b94-4505-8f05-83375be7c29c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:20.276498 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9deb1f-4b94-4505-8f05-83375be7c29c None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:20.287143 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 352/705] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Jul 13 23:35:20 2022] GET /identity/v3/endpoints?service_id=900761e2fb84419a9276ed65ff99c790&interface=public®ion_id=RegionOne => generated 194 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:20.297000 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9deb1f-4b94-4505-8f05-83375be7c29c None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:20.332664 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3872d-35b8-4750-af7e-8847405f666f None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:20.349659 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:20.375319 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b04a8-a6a0-42ba-a1d9-9244e9363fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:20.376127 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b04a8-a6a0-42ba-a1d9-9244e9363fa6 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:20.376413 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b04a8-a6a0-42ba-a1d9-9244e9363fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:20.376691 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b04a8-a6a0-42ba-a1d9-9244e9363fa6 None admin] PATH_INFO: `/v3/services/network` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:20.377408 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3b04a8-a6a0-42ba-a1d9-9244e9363fa6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:20.378780 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3b04a8-a6a0-42ba-a1d9-9244e9363fa6 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:20.394873 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-aa3b04a8-a6a0-42ba-a1d9-9244e9363fa6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 13 23:35:20.394873 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:20.394873 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 23:35:20.394873 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 23:35:20.394873 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 23:35:20.394873 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 23:35:20.394873 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 23:35:20.394873 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 23:35:20.394873 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 13 23:35:20.394873 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:20.394873 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 23:35:20.394873 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:20.394873 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:20.394873 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:20.394873 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:20.394873 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:20.394873 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:20.395978 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:20.395978 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:20.395978 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:20.395978 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:20.395978 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:20.395978 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:20.395978 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 23:35:20.395978 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 23:35:20.395978 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 23:35:20.395978 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 23:35:20.395978 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:20.395978 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:20.395978 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:20.395978 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:20.395978 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:20.395978 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:20.397356 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:20.397356 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:20.397356 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:20.397356 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:20.397356 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:20.397356 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:20.397356 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:20.397356 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:20.397356 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:20.397356 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:20.397356 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 23:35:20.397356 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 23:35:20.397356 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 13 23:35:20.397356 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:20.397356 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 354/706] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 13 23:35:20 2022] GET /identity/v3/services/network => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 23:35:20.406259 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b04a8-a6a0-42ba-a1d9-9244e9363fa6 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:20.416064 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9deb1f-4b94-4505-8f05-83375be7c29c None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:20.429642 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:20.457746 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e5f32-1ed0-4123-9660-f95d463a0082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:20.458845 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e5f32-1ed0-4123-9660-f95d463a0082 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:20.458845 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e5f32-1ed0-4123-9660-f95d463a0082 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:20.459162 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e5f32-1ed0-4123-9660-f95d463a0082 None admin] PATH_INFO: `/v3/services` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:20.459911 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e5f32-1ed0-4123-9660-f95d463a0082 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:20.461444 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e5f32-1ed0-4123-9660-f95d463a0082 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:20.473243 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 353/707] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jul 13 23:35:20 2022] GET /identity/v3/services => generated 1002 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 23:35:20.541440 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b04a8-a6a0-42ba-a1d9-9244e9363fa6 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:20.585378 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853bbb3-07ad-42ad-b8d7-e9f2da157d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:20.586322 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853bbb3-07ad-42ad-b8d7-e9f2da157d38 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:20.586761 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853bbb3-07ad-42ad-b8d7-e9f2da157d38 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:20.587218 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853bbb3-07ad-42ad-b8d7-e9f2da157d38 None admin] PATH_INFO: `/v3/services` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:20.588100 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0853bbb3-07ad-42ad-b8d7-e9f2da157d38 None admin] RBAC: Adding query filter params (name=network) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:20.589739 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0853bbb3-07ad-42ad-b8d7-e9f2da157d38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:20.591311 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0853bbb3-07ad-42ad-b8d7-e9f2da157d38 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:20.597240 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 355/708] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jul 13 23:35:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:20.605439 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e5f32-1ed0-4123-9660-f95d463a0082 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:20.726411 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e5f32-1ed0-4123-9660-f95d463a0082 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:20.764727 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a4b3a-a5e4-470f-b8b1-c882ba66f17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:20.765426 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a4b3a-a5e4-470f-b8b1-c882ba66f17f None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:20.765708 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a4b3a-a5e4-470f-b8b1-c882ba66f17f None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:20.765982 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a4b3a-a5e4-470f-b8b1-c882ba66f17f None admin] PATH_INFO: `/v3/services` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:20.766681 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a4b3a-a5e4-470f-b8b1-c882ba66f17f None admin] RBAC: Adding query filter params (type=network) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:20.766987 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a4b3a-a5e4-470f-b8b1-c882ba66f17f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:20.768341 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a4b3a-a5e4-470f-b8b1-c882ba66f17f None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:20.773721 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 354/709] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jul 13 23:35:20 2022] GET /identity/v3/services?type=network => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:20.780050 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853bbb3-07ad-42ad-b8d7-e9f2da157d38 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:20.825424 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:20.882637 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853bbb3-07ad-42ad-b8d7-e9f2da157d38 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:20.917620 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f86083-5f2f-4560-8671-99abc353dc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:20.918274 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f86083-5f2f-4560-8671-99abc353dc84 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:20.918559 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f86083-5f2f-4560-8671-99abc353dc84 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:20.918837 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f86083-5f2f-4560-8671-99abc353dc84 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:20.919622 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f86083-5f2f-4560-8671-99abc353dc84 None admin] RBAC: Adding query filter params (interface=public, service_id=5968b85e08414c3bbad485aafb503b49, region_id=RegionOne) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:20.919931 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f86083-5f2f-4560-8671-99abc353dc84 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:20.921332 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f86083-5f2f-4560-8671-99abc353dc84 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:20.926779 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 356/710] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Jul 13 23:35:20 2022] GET /identity/v3/endpoints?service_id=5968b85e08414c3bbad485aafb503b49&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:20.932573 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a4b3a-a5e4-470f-b8b1-c882ba66f17f None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:20.978136 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:21.047025 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a4b3a-a5e4-470f-b8b1-c882ba66f17f None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:21.089735 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983ac60-4e90-4e73-aa62-1b34e271abb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:21.090337 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983ac60-4e90-4e73-aa62-1b34e271abb2 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:21.090618 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983ac60-4e90-4e73-aa62-1b34e271abb2 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:21.091073 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983ac60-4e90-4e73-aa62-1b34e271abb2 None admin] PATH_INFO: `/v3/services` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:21.091767 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a983ac60-4e90-4e73-aa62-1b34e271abb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:21.093173 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a983ac60-4e90-4e73-aa62-1b34e271abb2 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:21.099661 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 355/711] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jul 13 23:35:20 2022] GET /identity/v3/services => generated 1002 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 23:35:21.563949 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc5e47-0ea0-4486-90ef-b2f55e3d56fb None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:21.564450 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc5e47-0ea0-4486-90ef-b2f55e3d56fb None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:21.564555 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc5e47-0ea0-4486-90ef-b2f55e3d56fb None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:21.566130 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 357/712] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:35:21.571168 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf1f41-d5e1-4d20-8b0e-67875da60605 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:21.571569 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf1f41-d5e1-4d20-8b0e-67875da60605 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:21.571736 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf1f41-d5e1-4d20-8b0e-67875da60605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:21.590305 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-5bdf1f41-d5e1-4d20-8b0e-67875da60605 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:35:21.591470 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-5bdf1f41-d5e1-4d20-8b0e-67875da60605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:35:21.662128 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 356/713] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:35:21 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 23:35:21.686676 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc5e47-0ea0-4486-90ef-b2f55e3d56fb None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:21.796199 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc5e47-0ea0-4486-90ef-b2f55e3d56fb None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:21.803434 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:21.831523 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d59225-4a57-4a6a-9f3d-85a2754ba191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:21.832793 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d59225-4a57-4a6a-9f3d-85a2754ba191 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:21.833318 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d59225-4a57-4a6a-9f3d-85a2754ba191 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:21.833815 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d59225-4a57-4a6a-9f3d-85a2754ba191 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:21.847915 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d59225-4a57-4a6a-9f3d-85a2754ba191 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:35:21.857550 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-24d59225-4a57-4a6a-9f3d-85a2754ba191 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 23:35:21.857550 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:21.857550 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:21.857550 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:21.857550 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:21.857550 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:21.857550 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:21.857550 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:21.857550 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:21.857550 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:21.857550 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:21.857550 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:21.857550 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:35:21.857550 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:35:21.857550 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:35:21.857550 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:35:21.858489 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:35:21.858489 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:35:21.858489 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:35:21.858489 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:35:21.858489 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:21.858489 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:21.858489 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:21.858489 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:21.858489 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:21.858489 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:21.858489 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:21.858489 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:21.858489 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:21.858489 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:21.858489 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:21.858489 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:21.859324 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:21.859324 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:21.859324 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:21.859324 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:21.859324 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:35:21.859324 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:35:21.859324 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:35:21.859324 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:35:21.859324 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:35:21.859324 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:35:21.859324 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 23:35:21.859324 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:21.859324 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 358/714] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 13 23:35:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:21.864790 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf1f41-d5e1-4d20-8b0e-67875da60605 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:21.897275 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:21.969332 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf1f41-d5e1-4d20-8b0e-67875da60605 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:22.003892 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b759d2-8e61-4ac8-bc80-88dd178b0c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:22.004558 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b759d2-8e61-4ac8-bc80-88dd178b0c0c None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:22.004847 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b759d2-8e61-4ac8-bc80-88dd178b0c0c None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:22.005141 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b759d2-8e61-4ac8-bc80-88dd178b0c0c None admin] PATH_INFO: `/v3/roles` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:22.005872 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b759d2-8e61-4ac8-bc80-88dd178b0c0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:22.006173 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b759d2-8e61-4ac8-bc80-88dd178b0c0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:22.007590 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b759d2-8e61-4ac8-bc80-88dd178b0c0c None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:22.016947 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 357/715] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:35:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:22.022507 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d59225-4a57-4a6a-9f3d-85a2754ba191 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:22.125035 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d59225-4a57-4a6a-9f3d-85a2754ba191 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:22.159829 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16abe20-ba11-4a43-bce1-7e970eba4da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:22.160621 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16abe20-ba11-4a43-bce1-7e970eba4da9 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:22.161188 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16abe20-ba11-4a43-bce1-7e970eba4da9 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:22.161296 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16abe20-ba11-4a43-bce1-7e970eba4da9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:22.173337 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16abe20-ba11-4a43-bce1-7e970eba4da9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:22.174791 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16abe20-ba11-4a43-bce1-7e970eba4da9 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:22.192605 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-c16abe20-ba11-4a43-bce1-7e970eba4da9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:35:22.192605 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:22.192605 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:22.192605 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:22.192605 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:22.192605 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:22.192605 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:22.192605 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:22.192605 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:22.192605 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:22.192605 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:22.192605 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:22.192605 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:35:22.192605 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:35:22.192605 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:35:22.193554 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:35:22.193554 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:22.193554 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:22.193554 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:22.193554 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:22.193554 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:22.193554 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:22.193554 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:22.193554 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:22.193554 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:22.193554 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:22.193554 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:22.193554 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:22.193554 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:22.193554 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:22.193554 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:22.193554 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:22.194894 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:35:22.194894 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:35:22.194894 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:35:22.194894 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:22.194894 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 359/716] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:35:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:22.200345 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b759d2-8e61-4ac8-bc80-88dd178b0c0c None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:22.309383 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:22.313387 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b759d2-8e61-4ac8-bc80-88dd178b0c0c None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:22.349569 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b918dd8-432a-4d1e-894d-c61d104fbf6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:22.350231 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b918dd8-432a-4d1e-894d-c61d104fbf6e None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:22.350513 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b918dd8-432a-4d1e-894d-c61d104fbf6e None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:22.350788 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b918dd8-432a-4d1e-894d-c61d104fbf6e None admin] PATH_INFO: `/v3/domains` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:22.351497 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b918dd8-432a-4d1e-894d-c61d104fbf6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:22.351799 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b918dd8-432a-4d1e-894d-c61d104fbf6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:22.353171 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b918dd8-432a-4d1e-894d-c61d104fbf6e None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:22.365964 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 358/717] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:35:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:22.372257 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16abe20-ba11-4a43-bce1-7e970eba4da9 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:22.393250 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:22.413993 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d66db-cc91-4c92-b313-11c9ec409e5c None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:22.414635 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d66db-cc91-4c92-b313-11c9ec409e5c None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:22.415120 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d66db-cc91-4c92-b313-11c9ec409e5c None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:22.417567 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 359/718] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:35:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 23:35:22.422801 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92522480-9cca-4f24-be24-beb6ea54976b None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:22.423354 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92522480-9cca-4f24-be24-beb6ea54976b None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:22.423839 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92522480-9cca-4f24-be24-beb6ea54976b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:22.442128 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-92522480-9cca-4f24-be24-beb6ea54976b None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:35:22.443622 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-92522480-9cca-4f24-be24-beb6ea54976b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:35:22.490374 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16abe20-ba11-4a43-bce1-7e970eba4da9 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:22.537655 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 360/719] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:35:22 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 23:35:22.542989 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb84320-d4de-4bcf-a1d3-7a1347ad743a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:22.544259 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb84320-d4de-4bcf-a1d3-7a1347ad743a None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:22.544259 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb84320-d4de-4bcf-a1d3-7a1347ad743a None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:22.544259 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb84320-d4de-4bcf-a1d3-7a1347ad743a None admin] PATH_INFO: `/v3/users/nova` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:22.551432 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb84320-d4de-4bcf-a1d3-7a1347ad743a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:22.552971 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb84320-d4de-4bcf-a1d3-7a1347ad743a None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:22.561496 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92522480-9cca-4f24-be24-beb6ea54976b None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:22.569601 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-4cb84320-d4de-4bcf-a1d3-7a1347ad743a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 23:35:22.569601 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:22.569601 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:22.569601 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:22.569601 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:22.569601 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:22.569601 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:22.569601 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:22.569601 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:22.569601 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:22.569601 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:22.569601 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:22.569601 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 23:35:22.569601 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 23:35:22.569601 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 23:35:22.569601 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 23:35:22.570860 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:22.570860 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:22.570860 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 23:35:22.570860 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 23:35:22.570860 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 23:35:22.570860 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 23:35:22.570860 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:22.570860 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:22.570860 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:22.570860 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:22.570860 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:22.570860 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:22.570860 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:22.570860 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:22.570860 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:22.570860 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:22.570860 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:22.570860 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:22.571806 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:22.571806 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:22.571806 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 23:35:22.571806 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 23:35:22.571806 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 23:35:22.571806 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 23:35:22.571806 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 23:35:22.571806 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 23:35:22.571806 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 13 23:35:22.571806 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:22.571806 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 360/720] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jul 13 23:35:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:22.578452 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb84320-d4de-4bcf-a1d3-7a1347ad743a None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:22.673275 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:22.675584 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:22.696577 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92522480-9cca-4f24-be24-beb6ea54976b None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:22.702290 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb84320-d4de-4bcf-a1d3-7a1347ad743a None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:22.740114 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d2414c-7c1d-44af-9226-13343bedb785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:22.741064 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2414c-7c1d-44af-9226-13343bedb785 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:22.741306 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2414c-7c1d-44af-9226-13343bedb785 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:22.741583 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2414c-7c1d-44af-9226-13343bedb785 None admin] PATH_INFO: `/v3/services/image` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:22.742237 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d2414c-7c1d-44af-9226-13343bedb785 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:22.743599 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d2414c-7c1d-44af-9226-13343bedb785 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:22.751511 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb4bd6e-f558-45e8-b3b9-cf44e4f5520a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:22.752456 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb4bd6e-f558-45e8-b3b9-cf44e4f5520a None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:22.752990 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb4bd6e-f558-45e8-b3b9-cf44e4f5520a None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:22.753483 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb4bd6e-f558-45e8-b3b9-cf44e4f5520a None admin] PATH_INFO: `/v3/users` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:22.754668 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb4bd6e-f558-45e8-b3b9-cf44e4f5520a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:22.755181 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb4bd6e-f558-45e8-b3b9-cf44e4f5520a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:22.756679 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-80d2414c-7c1d-44af-9226-13343bedb785 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 13 23:35:22.756679 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:22.756679 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 23:35:22.756679 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 23:35:22.756679 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 23:35:22.756679 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 23:35:22.756679 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 23:35:22.756679 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 23:35:22.756679 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 13 23:35:22.756679 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:22.756679 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 23:35:22.756679 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:22.756679 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:22.756679 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:22.756679 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:22.756679 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:22.756679 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:22.757692 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:22.757692 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:22.757692 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:22.757692 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:22.757692 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:22.757692 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:22.757692 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 23:35:22.757692 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 23:35:22.757692 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 23:35:22.757692 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 23:35:22.757692 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:22.757692 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:22.757692 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:22.757692 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:22.757692 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:22.757692 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:22.758535 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:22.758535 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:22.758535 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:22.758535 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:22.758535 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:22.758535 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:22.758535 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:22.758535 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:22.758535 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:22.758535 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:22.758535 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 23:35:22.758535 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 23:35:22.758535 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 13 23:35:22.758535 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:22.759884 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb4bd6e-f558-45e8-b3b9-cf44e4f5520a None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:22.764409 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 361/721] 10.222.0.16 () {56 vars in 1105 bytes} [Wed Jul 13 23:35:22 2022] GET /identity/v3/services/image => generated 86 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:22.764623 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d2414c-7c1d-44af-9226-13343bedb785 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:22.792809 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 361/722] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 13 23:35:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:22.793530 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb4bd6e-f558-45e8-b3b9-cf44e4f5520a None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:22.891371 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d2414c-7c1d-44af-9226-13343bedb785 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:22.910799 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb4bd6e-f558-45e8-b3b9-cf44e4f5520a None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:22.927461 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a7f9d-5678-4e7b-a551-e0c25e7ca111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:22.928047 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a7f9d-5678-4e7b-a551-e0c25e7ca111 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:22.928326 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a7f9d-5678-4e7b-a551-e0c25e7ca111 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:22.928591 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a7f9d-5678-4e7b-a551-e0c25e7ca111 None admin] PATH_INFO: `/v3/services` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:22.929320 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a7f9d-5678-4e7b-a551-e0c25e7ca111 None admin] RBAC: Adding query filter params (name=image) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:22.929623 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a7f9d-5678-4e7b-a551-e0c25e7ca111 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:22.930963 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a7f9d-5678-4e7b-a551-e0c25e7ca111 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:22.936193 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 362/723] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:35:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:22.938206 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ba246-35c6-4b5d-a08a-5f4b1873ff74 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:22.939018 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ba246-35c6-4b5d-a08a-5f4b1873ff74 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:22.939763 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ba246-35c6-4b5d-a08a-5f4b1873ff74 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:22.941866 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 363/724] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:35:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:35:22.943143 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ba246-35c6-4b5d-a08a-5f4b1873ff74 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:22.949164 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2b9dc-a545-462d-bfe3-faa324a55ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:22.949842 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2b9dc-a545-462d-bfe3-faa324a55ee7 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:22.950123 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2b9dc-a545-462d-bfe3-faa324a55ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:22.950396 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2b9dc-a545-462d-bfe3-faa324a55ee7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:22.953903 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:22.964222 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:23.029480 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2b9dc-a545-462d-bfe3-faa324a55ee7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:23.030930 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2b9dc-a545-462d-bfe3-faa324a55ee7 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:23.061780 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ba246-35c6-4b5d-a08a-5f4b1873ff74 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:23.099228 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb6607-0472-4f82-90fa-6bbe3f8b08ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:23.099894 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb6607-0472-4f82-90fa-6bbe3f8b08ff None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:23.100179 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb6607-0472-4f82-90fa-6bbe3f8b08ff None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:23.100461 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb6607-0472-4f82-90fa-6bbe3f8b08ff None admin] PATH_INFO: `/v3/services` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:23.101192 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb6607-0472-4f82-90fa-6bbe3f8b08ff None admin] RBAC: Adding query filter params (type=image) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:23.101500 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb6607-0472-4f82-90fa-6bbe3f8b08ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:23.102854 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb6607-0472-4f82-90fa-6bbe3f8b08ff None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:23.112764 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 364/725] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:35:22 2022] GET /identity/v3/services?type=image => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:23.112764 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e5d94-776a-4590-a600-4a9707d48ecc None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:23.112764 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e5d94-776a-4590-a600-4a9707d48ecc None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:23.112764 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e5d94-776a-4590-a600-4a9707d48ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:23.127702 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-891e5d94-776a-4590-a600-4a9707d48ecc None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:35:23.128908 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-891e5d94-776a-4590-a600-4a9707d48ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:35:23.150274 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 362/726] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 13 23:35:22 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 13 23:35:23.150274 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2b9dc-a545-462d-bfe3-faa324a55ee7 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:23.186143 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:23.203796 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 365/727] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:35:23 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 23:35:23.204639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e5d94-776a-4590-a600-4a9707d48ecc None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:23.218535 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:23.262922 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2b9dc-a545-462d-bfe3-faa324a55ee7 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:23.298893 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4bd94-30ea-406d-98c4-8340406aa70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:23.299546 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4bd94-30ea-406d-98c4-8340406aa70d None admin] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:23.299834 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4bd94-30ea-406d-98c4-8340406aa70d None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:23.300108 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4bd94-30ea-406d-98c4-8340406aa70d None admin] PATH_INFO: `/v3/endpoints` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:23.300853 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4bd94-30ea-406d-98c4-8340406aa70d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:23.302214 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4bd94-30ea-406d-98c4-8340406aa70d None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:23.325461 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 363/728] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 13 23:35:23 2022] POST /identity/v3/endpoints => generated 327 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 23:35:23.326551 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4bd94-30ea-406d-98c4-8340406aa70d None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:23.326898 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e5d94-776a-4590-a600-4a9707d48ecc None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:23.389645 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def83842-5210-4ab4-83a8-f9703d25ecd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:23.390883 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def83842-5210-4ab4-83a8-f9703d25ecd4 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:23.392180 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def83842-5210-4ab4-83a8-f9703d25ecd4 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:23.392667 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def83842-5210-4ab4-83a8-f9703d25ecd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:23.409564 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def83842-5210-4ab4-83a8-f9703d25ecd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:23.411456 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def83842-5210-4ab4-83a8-f9703d25ecd4 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:23.431437 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-def83842-5210-4ab4-83a8-f9703d25ecd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:35:23.431437 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:23.431437 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:23.431437 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:23.431437 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:23.431437 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:23.431437 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:23.431437 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:23.431437 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:23.431437 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:23.431437 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:23.431437 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:23.431437 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:35:23.431437 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:35:23.431437 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:35:23.433151 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:35:23.433151 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:23.433151 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:23.433151 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:23.433151 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:23.433151 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:23.433151 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:23.433151 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:23.433151 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:23.433151 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:23.433151 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:23.433151 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:23.433151 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:23.433151 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:23.433151 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:23.433151 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:23.433151 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:23.435289 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:35:23.435289 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:35:23.435289 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:35:23.435289 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:23.435289 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 366/729] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:35:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:23.435289 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e23ba-8ef7-42a0-9638-07315ed7c331 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:23.435289 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e23ba-8ef7-42a0-9638-07315ed7c331 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:23.435289 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e23ba-8ef7-42a0-9638-07315ed7c331 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:23.436624 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 367/730] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:35:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:35:23.441329 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e23ba-8ef7-42a0-9638-07315ed7c331 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:23.457174 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:23.468249 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4bd94-30ea-406d-98c4-8340406aa70d None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:23.508554 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7451682-3da8-41b0-a470-fdfc43f06f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:23.509634 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:23.509846 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7451682-3da8-41b0-a470-fdfc43f06f10 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:23.510697 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7451682-3da8-41b0-a470-fdfc43f06f10 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:23.511058 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7451682-3da8-41b0-a470-fdfc43f06f10 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:23.512812 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7451682-3da8-41b0-a470-fdfc43f06f10 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:23.513619 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7451682-3da8-41b0-a470-fdfc43f06f10 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:23.527432 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-a7451682-3da8-41b0-a470-fdfc43f06f10 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 13 23:35:23.527432 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:23.527432 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 23:35:23.527432 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 23:35:23.527432 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 23:35:23.527432 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 23:35:23.527432 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 23:35:23.527432 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 23:35:23.527432 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 13 23:35:23.527432 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:23.527432 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 23:35:23.527432 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:23.527432 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:23.527432 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:23.527432 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:23.527432 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:23.528583 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:23.528583 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:23.528583 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:23.528583 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:23.528583 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:23.528583 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:23.528583 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:23.528583 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 23:35:23.528583 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 23:35:23.528583 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 23:35:23.528583 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 23:35:23.528583 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:23.528583 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:23.528583 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:23.528583 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:23.528583 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:23.529651 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:23.529651 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:23.529651 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:23.529651 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:23.529651 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:23.529651 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:23.529651 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:23.529651 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:23.529651 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:23.529651 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:23.529651 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:23.529651 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 23:35:23.529651 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 23:35:23.529651 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 13 23:35:23.529651 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:23.529651 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 364/731] 10.222.0.16 () {56 vars in 1129 bytes} [Wed Jul 13 23:35:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:23.530667 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a75ff-fae2-4957-8567-7353d9110bc8 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:23.530667 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a75ff-fae2-4957-8567-7353d9110bc8 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:23.530822 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a75ff-fae2-4957-8567-7353d9110bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:23.552405 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-6d6a75ff-fae2-4957-8567-7353d9110bc8 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:35:23.553658 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-6d6a75ff-fae2-4957-8567-7353d9110bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:35:23.575484 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e23ba-8ef7-42a0-9638-07315ed7c331 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:23.613401 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a939bc-cb3c-4482-825c-8052ff323a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:23.614248 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a939bc-cb3c-4482-825c-8052ff323a5a None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:23.614598 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a939bc-cb3c-4482-825c-8052ff323a5a None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:23.614937 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a939bc-cb3c-4482-825c-8052ff323a5a None admin] PATH_INFO: `/v3/domains` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:23.615715 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a939bc-cb3c-4482-825c-8052ff323a5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:23.616087 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a939bc-cb3c-4482-825c-8052ff323a5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:23.617536 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a939bc-cb3c-4482-825c-8052ff323a5a None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:23.629476 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 368/732] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:35:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:23.630272 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a939bc-cb3c-4482-825c-8052ff323a5a None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:23.636976 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 365/733] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:35:23 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 23:35:23.638663 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a75ff-fae2-4957-8567-7353d9110bc8 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:23.732156 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:23.741532 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a939bc-cb3c-4482-825c-8052ff323a5a None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:23.748397 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a75ff-fae2-4957-8567-7353d9110bc8 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:23.756407 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:23.780131 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4e285-bc3e-4291-a804-bce35ceed227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:23.780800 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4e285-bc3e-4291-a804-bce35ceed227 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:23.781122 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4e285-bc3e-4291-a804-bce35ceed227 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:23.781612 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4e285-bc3e-4291-a804-bce35ceed227 None admin] PATH_INFO: `/v3/services` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:23.782320 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4e285-bc3e-4291-a804-bce35ceed227 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:23.782715 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4e285-bc3e-4291-a804-bce35ceed227 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:23.784290 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4e285-bc3e-4291-a804-bce35ceed227 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:23.784786 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a429269-a8fb-476d-af17-9a4dd33d7bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:23.785665 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a429269-a8fb-476d-af17-9a4dd33d7bba None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:23.786020 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a429269-a8fb-476d-af17-9a4dd33d7bba None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:23.786375 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a429269-a8fb-476d-af17-9a4dd33d7bba None admin] PATH_INFO: `/v3/projects/service` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:23.793436 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 369/734] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jul 13 23:35:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:23.794391 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4e285-bc3e-4291-a804-bce35ceed227 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:23.795546 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a429269-a8fb-476d-af17-9a4dd33d7bba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:23.797018 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a429269-a8fb-476d-af17-9a4dd33d7bba None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:23.811541 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-4a429269-a8fb-476d-af17-9a4dd33d7bba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 23:35:23.811541 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:23.811541 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:23.811541 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:23.811541 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:23.811541 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:23.811541 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:23.811541 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:23.811541 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:23.811541 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:23.811541 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:23.811541 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:23.811541 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 23:35:23.811541 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 23:35:23.811541 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 23:35:23.812732 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 23:35:23.812732 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:23.812732 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:23.812732 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:23.812732 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:23.812732 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:23.812732 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:23.812732 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:23.812732 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:23.812732 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:23.812732 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:23.812732 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:23.812732 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:23.812732 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:23.812732 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:23.812732 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:23.812732 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:23.813718 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 23:35:23.813718 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 23:35:23.813718 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 23:35:23.813718 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 23:35:23.813718 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 23:35:23.813718 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 23:35:23.813718 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 23:35:23.813718 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:23.813718 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 366/735] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 13 23:35:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:23.813718 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a429269-a8fb-476d-af17-9a4dd33d7bba None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:23.908005 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4e285-bc3e-4291-a804-bce35ceed227 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:23.928082 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a429269-a8fb-476d-af17-9a4dd33d7bba None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:23.945356 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472168a3-1b14-4621-a236-d864505339f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:23.946157 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472168a3-1b14-4621-a236-d864505339f0 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:23.946439 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472168a3-1b14-4621-a236-d864505339f0 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:23.946716 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472168a3-1b14-4621-a236-d864505339f0 None admin] PATH_INFO: `/v3/services/network` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:23.947362 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472168a3-1b14-4621-a236-d864505339f0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:23.949282 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472168a3-1b14-4621-a236-d864505339f0 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:23.961914 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-472168a3-1b14-4621-a236-d864505339f0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 13 23:35:23.961914 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:23.961914 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 23:35:23.961914 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 23:35:23.961914 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 23:35:23.961914 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 23:35:23.961914 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 23:35:23.961914 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 23:35:23.961914 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 13 23:35:23.961914 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:23.961914 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 23:35:23.961914 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:23.961914 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:23.961914 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:23.961914 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:23.961914 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:23.961914 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:23.962957 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:23.962957 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:23.962957 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:23.962957 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:23.962957 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:23.962957 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:23.962957 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 23:35:23.962957 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 23:35:23.962957 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 23:35:23.962957 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 23:35:23.962957 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:23.962957 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:23.962957 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:23.962957 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:23.962957 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:23.962957 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:23.964401 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:23.964401 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:23.964401 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:23.964401 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:23.964401 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:23.964401 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:23.964401 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:23.964401 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:23.964401 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:23.964401 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:23.964401 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 23:35:23.964401 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 23:35:23.964401 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 13 23:35:23.964401 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:23.964401 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 370/736] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 13 23:35:23 2022] GET /identity/v3/services/network => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:23.965253 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472168a3-1b14-4621-a236-d864505339f0 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:23.973526 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf9b52-c6f7-46fd-ab0c-d8c9d33928c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:23.974795 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf9b52-c6f7-46fd-ab0c-d8c9d33928c0 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:23.975237 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf9b52-c6f7-46fd-ab0c-d8c9d33928c0 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:23.975689 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf9b52-c6f7-46fd-ab0c-d8c9d33928c0 None admin] PATH_INFO: `/v3/services` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:23.976947 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf9b52-c6f7-46fd-ab0c-d8c9d33928c0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:23.977413 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf9b52-c6f7-46fd-ab0c-d8c9d33928c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:23.979664 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf9b52-c6f7-46fd-ab0c-d8c9d33928c0 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:23.990566 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 367/737] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jul 13 23:35:23 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:23.990566 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf9b52-c6f7-46fd-ab0c-d8c9d33928c0 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:24.004214 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:24.013524 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:24.070485 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472168a3-1b14-4621-a236-d864505339f0 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:24.100305 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf9b52-c6f7-46fd-ab0c-d8c9d33928c0 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:24.105889 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110497e7-d4a9-4e27-94d4-535f32226534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:24.106545 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110497e7-d4a9-4e27-94d4-535f32226534 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:24.106825 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110497e7-d4a9-4e27-94d4-535f32226534 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:24.107097 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110497e7-d4a9-4e27-94d4-535f32226534 None admin] PATH_INFO: `/v3/projects` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:24.107867 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110497e7-d4a9-4e27-94d4-535f32226534 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:24.108178 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110497e7-d4a9-4e27-94d4-535f32226534 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:24.109625 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110497e7-d4a9-4e27-94d4-535f32226534 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:24.121874 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 371/738] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 13 23:35:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:24.122659 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110497e7-d4a9-4e27-94d4-535f32226534 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:24.146916 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14efe2d-72a4-4288-b851-1f389bf12045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:24.147907 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14efe2d-72a4-4288-b851-1f389bf12045 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:24.148388 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14efe2d-72a4-4288-b851-1f389bf12045 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:24.148874 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14efe2d-72a4-4288-b851-1f389bf12045 None admin] PATH_INFO: `/v3/services` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:24.149763 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14efe2d-72a4-4288-b851-1f389bf12045 None admin] RBAC: Adding query filter params (name=network) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:24.150249 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14efe2d-72a4-4288-b851-1f389bf12045 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:24.152374 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14efe2d-72a4-4288-b851-1f389bf12045 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:24.157891 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 368/739] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jul 13 23:35:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:24.158756 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14efe2d-72a4-4288-b851-1f389bf12045 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:24.240149 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:24.243922 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110497e7-d4a9-4e27-94d4-535f32226534 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:24.247146 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:24.268711 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14efe2d-72a4-4288-b851-1f389bf12045 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:24.288770 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9903a5-8ae9-46c3-b19b-13c04d0b2a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:24.289459 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9903a5-8ae9-46c3-b19b-13c04d0b2a4e None admin] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:24.289745 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9903a5-8ae9-46c3-b19b-13c04d0b2a4e None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:24.290022 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9903a5-8ae9-46c3-b19b-13c04d0b2a4e None admin] PATH_INFO: `/v3/endpoints` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:24.290761 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9903a5-8ae9-46c3-b19b-13c04d0b2a4e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:24.292840 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9903a5-8ae9-46c3-b19b-13c04d0b2a4e None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:24.306841 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84418f75-a884-4da1-b1c7-8568f51d1596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:24.307585 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84418f75-a884-4da1-b1c7-8568f51d1596 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:24.307937 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84418f75-a884-4da1-b1c7-8568f51d1596 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:24.308281 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84418f75-a884-4da1-b1c7-8568f51d1596 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:24.309220 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84418f75-a884-4da1-b1c7-8568f51d1596 None admin] RBAC: Adding query filter params (role.id=46deff0e06964626a5600c9641454603, scope.project.id=11b8489ad08d40bc8f19a6ffa01c6897, user.id=a7e276c4bd434c028274e059a73c4060) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:24.309534 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84418f75-a884-4da1-b1c7-8568f51d1596 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:24.311007 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84418f75-a884-4da1-b1c7-8568f51d1596 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:24.325591 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 369/740] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 13 23:35:24 2022] GET /identity/v3/role_assignments?user.id=a7e276c4bd434c028274e059a73c4060&scope.project.id=11b8489ad08d40bc8f19a6ffa01c6897&role.id=46deff0e06964626a5600c9641454603 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:24.325591 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84418f75-a884-4da1-b1c7-8568f51d1596 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:24.325932 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 372/741] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 13 23:35:24 2022] POST /identity/v3/endpoints => generated 346 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 23:35:24.457658 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84418f75-a884-4da1-b1c7-8568f51d1596 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:24.505764 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b18f7-eee6-4daf-ad36-705a0757360f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:24.506706 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b18f7-eee6-4daf-ad36-705a0757360f None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:24.507141 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b18f7-eee6-4daf-ad36-705a0757360f None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:24.507607 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b18f7-eee6-4daf-ad36-705a0757360f None admin] PATH_INFO: `/v3/services` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:24.508527 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82b18f7-eee6-4daf-ad36-705a0757360f None admin] RBAC: Adding query filter params (type=network) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:24.509025 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82b18f7-eee6-4daf-ad36-705a0757360f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:24.510821 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82b18f7-eee6-4daf-ad36-705a0757360f None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:24.517907 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 370/742] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jul 13 23:35:24 2022] GET /identity/v3/services?type=network => generated 350 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:24.519165 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:24.523939 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9903a5-8ae9-46c3-b19b-13c04d0b2a4e None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:24.646256 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9903a5-8ae9-46c3-b19b-13c04d0b2a4e None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:24.682494 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a84259-df87-4789-b9be-509d2015545d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:24.683226 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a84259-df87-4789-b9be-509d2015545d None admin] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:24.683580 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a84259-df87-4789-b9be-509d2015545d None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:24.683866 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a84259-df87-4789-b9be-509d2015545d None admin] PATH_INFO: `/v3/endpoints` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:24.684662 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a84259-df87-4789-b9be-509d2015545d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:24.686074 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a84259-df87-4789-b9be-509d2015545d None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:24.708720 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 373/743] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 13 23:35:24 2022] POST /identity/v3/endpoints => generated 327 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 23:35:25.624043 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a5161-6cca-47c4-9716-1c98b2fe9f52 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:25.624563 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a5161-6cca-47c4-9716-1c98b2fe9f52 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:25.624672 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a5161-6cca-47c4-9716-1c98b2fe9f52 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:25.626137 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 371/744] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:35:25.631326 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071ec48-6bd8-48c0-a20b-f8296eab94ea None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:25.631743 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071ec48-6bd8-48c0-a20b-f8296eab94ea None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:25.631945 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071ec48-6bd8-48c0-a20b-f8296eab94ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:25.649754 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-8071ec48-6bd8-48c0-a20b-f8296eab94ea None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:35:25.651658 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-8071ec48-6bd8-48c0-a20b-f8296eab94ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:35:25.661836 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:25.726806 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 374/745] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:35:25 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 23:35:25.750219 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a5161-6cca-47c4-9716-1c98b2fe9f52 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:25.848450 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a5161-6cca-47c4-9716-1c98b2fe9f52 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:25.881569 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0035bb-fe3e-4c5f-a9e7-caf9f4e2bff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:25.882204 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0035bb-fe3e-4c5f-a9e7-caf9f4e2bff6 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:25.882487 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0035bb-fe3e-4c5f-a9e7-caf9f4e2bff6 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:25.882762 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0035bb-fe3e-4c5f-a9e7-caf9f4e2bff6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:25.944728 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:25.949245 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0035bb-fe3e-4c5f-a9e7-caf9f4e2bff6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:25.950707 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0035bb-fe3e-4c5f-a9e7-caf9f4e2bff6 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:26.050095 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 372/746] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 13 23:35:25 2022] GET /identity/v3/auth/tokens => generated 1396 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 23:35:26.055593 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071ec48-6bd8-48c0-a20b-f8296eab94ea None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:26.156104 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071ec48-6bd8-48c0-a20b-f8296eab94ea None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:26.193190 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ccdb8f-167d-402a-a699-18be5bd123cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:26.193984 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccdb8f-167d-402a-a699-18be5bd123cb None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:26.194270 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccdb8f-167d-402a-a699-18be5bd123cb None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:26.194540 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccdb8f-167d-402a-a699-18be5bd123cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:26.203306 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:26.206099 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ccdb8f-167d-402a-a699-18be5bd123cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:26.207546 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ccdb8f-167d-402a-a699-18be5bd123cb None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:26.226464 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-12ccdb8f-167d-402a-a699-18be5bd123cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:35:26.226464 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:26.226464 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:26.226464 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:26.226464 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:26.226464 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:26.226464 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:26.226464 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:26.226464 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:26.226464 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:26.226464 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:26.226464 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:26.226464 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:35:26.226464 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:35:26.226464 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:35:26.227382 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:35:26.227382 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:26.227382 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:26.227382 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:26.227382 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:26.227382 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:26.227382 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:26.227382 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:26.227382 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:26.227382 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:26.227382 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:26.227382 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:26.227382 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:26.227382 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:26.227382 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:26.227382 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:26.227382 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:26.228268 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:35:26.228268 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:35:26.228268 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:35:26.228268 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:26.229613 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 375/747] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:35:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 23:35:26.234036 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0035bb-fe3e-4c5f-a9e7-caf9f4e2bff6 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:26.331196 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:26.335886 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0035bb-fe3e-4c5f-a9e7-caf9f4e2bff6 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:26.370674 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f74bb7-0bac-4f9c-8200-75917074fb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:26.371326 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f74bb7-0bac-4f9c-8200-75917074fb80 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:26.371605 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f74bb7-0bac-4f9c-8200-75917074fb80 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:26.371876 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f74bb7-0bac-4f9c-8200-75917074fb80 None admin] PATH_INFO: `/v3/domains` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:26.372586 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f74bb7-0bac-4f9c-8200-75917074fb80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:26.372916 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f74bb7-0bac-4f9c-8200-75917074fb80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:26.374337 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f74bb7-0bac-4f9c-8200-75917074fb80 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:26.386411 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 373/748] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:35:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:26.696773 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5789d4-fb14-4592-8dd5-268b87e189ef None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:26.697418 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5789d4-fb14-4592-8dd5-268b87e189ef None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:26.697418 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5789d4-fb14-4592-8dd5-268b87e189ef None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:26.698991 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 376/749] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:35:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:35:26.704189 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e1aec-3283-43e9-b4d7-1540ceebff88 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:26.704619 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e1aec-3283-43e9-b4d7-1540ceebff88 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:26.704938 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e1aec-3283-43e9-b4d7-1540ceebff88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:26.722755 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-e53e1aec-3283-43e9-b4d7-1540ceebff88 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:35:26.723924 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-e53e1aec-3283-43e9-b4d7-1540ceebff88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:35:26.739672 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915daa7a-4cda-426d-b087-14e55ef7b1c5 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:26.739958 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915daa7a-4cda-426d-b087-14e55ef7b1c5 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:26.740232 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915daa7a-4cda-426d-b087-14e55ef7b1c5 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:26.741592 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 377/750] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:35:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 23:35:26.746592 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a44b4-1941-4203-91ed-19d548d06595 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:26.746880 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a44b4-1941-4203-91ed-19d548d06595 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:26.747160 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a44b4-1941-4203-91ed-19d548d06595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:26.763686 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-2a6a44b4-1941-4203-91ed-19d548d06595 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:35:26.764892 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-2a6a44b4-1941-4203-91ed-19d548d06595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:35:26.796105 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 374/751] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:35:26 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 23:35:26.819181 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e1aec-3283-43e9-b4d7-1540ceebff88 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:26.833955 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 378/752] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:35:26 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 23:35:26.857363 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a44b4-1941-4203-91ed-19d548d06595 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:26.905112 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:26.917544 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e1aec-3283-43e9-b4d7-1540ceebff88 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:26.951143 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3445ef-1a0d-44b6-9ed7-d9ed77f63586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:26.951935 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3445ef-1a0d-44b6-9ed7-d9ed77f63586 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:26.952219 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3445ef-1a0d-44b6-9ed7-d9ed77f63586 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:26.952496 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3445ef-1a0d-44b6-9ed7-d9ed77f63586 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:26.953175 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3445ef-1a0d-44b6-9ed7-d9ed77f63586 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:26.954298 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a44b4-1941-4203-91ed-19d548d06595 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:26.954539 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3445ef-1a0d-44b6-9ed7-d9ed77f63586 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:26.966769 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-9d3445ef-1a0d-44b6-9ed7-d9ed77f63586 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 13 23:35:26.966769 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:26.966769 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 23:35:26.966769 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 23:35:26.966769 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 23:35:26.966769 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 23:35:26.966769 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 23:35:26.966769 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 23:35:26.966769 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 13 23:35:26.966769 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:26.966769 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 23:35:26.966769 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:26.966769 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:26.966769 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:26.966769 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:26.966769 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:26.966769 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:26.967974 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:26.967974 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:26.967974 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:26.967974 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:26.967974 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:26.967974 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:26.967974 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 23:35:26.967974 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 23:35:26.967974 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 23:35:26.967974 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 23:35:26.967974 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:26.967974 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:26.967974 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:26.967974 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:26.967974 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:26.967974 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:26.968801 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:26.968801 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:26.968801 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:26.968801 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:26.968801 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:26.968801 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:26.968801 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:26.968801 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:26.968801 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:26.968801 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:26.968801 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 23:35:26.968801 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 23:35:26.968801 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 13 23:35:26.968801 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:26.968801 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 375/753] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jul 13 23:35:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 23:35:26.973790 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3445ef-1a0d-44b6-9ed7-d9ed77f63586 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:26.978094 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:26.990090 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553aeb2a-b105-44c0-b4a1-8fbb485dbcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:26.990892 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553aeb2a-b105-44c0-b4a1-8fbb485dbcff None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:26.991174 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553aeb2a-b105-44c0-b4a1-8fbb485dbcff None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:26.991441 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553aeb2a-b105-44c0-b4a1-8fbb485dbcff None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:26.992082 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553aeb2a-b105-44c0-b4a1-8fbb485dbcff None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:26.993579 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553aeb2a-b105-44c0-b4a1-8fbb485dbcff None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:27.005765 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-553aeb2a-b105-44c0-b4a1-8fbb485dbcff None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 13 23:35:27.005765 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:27.005765 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 23:35:27.005765 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 23:35:27.005765 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 23:35:27.005765 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 23:35:27.005765 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 23:35:27.005765 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 23:35:27.005765 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 13 23:35:27.005765 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:27.005765 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 23:35:27.005765 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:27.005765 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:27.005765 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:27.005765 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:27.005765 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:27.006696 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:27.006696 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:27.006696 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:27.006696 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:27.006696 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:27.006696 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:27.006696 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:27.006696 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 23:35:27.006696 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 23:35:27.006696 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 23:35:27.006696 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 23:35:27.006696 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:27.006696 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:27.006696 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:27.006696 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:27.006696 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:27.007518 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:27.007518 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:27.007518 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:27.007518 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:27.007518 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:27.007518 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:27.007518 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:27.007518 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:27.007518 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:27.007518 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:27.007518 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:27.007518 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 23:35:27.007518 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 23:35:27.007518 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 13 23:35:27.007518 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:27.007518 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 379/754] 10.222.0.16 () {56 vars in 1132 bytes} [Wed Jul 13 23:35:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 23:35:27.013728 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553aeb2a-b105-44c0-b4a1-8fbb485dbcff None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:27.073839 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3445ef-1a0d-44b6-9ed7-d9ed77f63586 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:27.108303 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f7106-ce3d-43e8-afdc-c7ee4a894a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:27.108995 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f7106-ce3d-43e8-afdc-c7ee4a894a93 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:27.109283 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f7106-ce3d-43e8-afdc-c7ee4a894a93 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:27.109602 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f7106-ce3d-43e8-afdc-c7ee4a894a93 None admin] PATH_INFO: `/v3/services` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:27.110302 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1f7106-ce3d-43e8-afdc-c7ee4a894a93 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:27.110609 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1f7106-ce3d-43e8-afdc-c7ee4a894a93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:27.111973 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1f7106-ce3d-43e8-afdc-c7ee4a894a93 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:27.116383 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 376/755] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jul 13 23:35:26 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:35:27.117154 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553aeb2a-b105-44c0-b4a1-8fbb485dbcff None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:27.122444 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f7106-ce3d-43e8-afdc-c7ee4a894a93 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:27.139766 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:27.153070 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41276e-d5c3-49dd-b496-312f4f98ef25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:27.153734 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41276e-d5c3-49dd-b496-312f4f98ef25 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:27.154017 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41276e-d5c3-49dd-b496-312f4f98ef25 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:27.154291 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41276e-d5c3-49dd-b496-312f4f98ef25 None admin] PATH_INFO: `/v3/services` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:27.154981 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f41276e-d5c3-49dd-b496-312f4f98ef25 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:27.155285 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f41276e-d5c3-49dd-b496-312f4f98ef25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:27.156635 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f41276e-d5c3-49dd-b496-312f4f98ef25 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:27.161179 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 380/756] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jul 13 23:35:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:35:27.167828 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41276e-d5c3-49dd-b496-312f4f98ef25 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:27.222594 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:27.231583 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f7106-ce3d-43e8-afdc-c7ee4a894a93 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:27.264226 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab58ec7f-823d-4962-94a8-17409c56c045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:27.265123 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58ec7f-823d-4962-94a8-17409c56c045 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:27.265408 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58ec7f-823d-4962-94a8-17409c56c045 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:27.265681 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58ec7f-823d-4962-94a8-17409c56c045 None admin] PATH_INFO: `/v3/services` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:27.266379 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab58ec7f-823d-4962-94a8-17409c56c045 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:27.266682 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab58ec7f-823d-4962-94a8-17409c56c045 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:27.268042 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab58ec7f-823d-4962-94a8-17409c56c045 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:27.271876 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41276e-d5c3-49dd-b496-312f4f98ef25 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:27.272315 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 377/757] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jul 13 23:35:27 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:35:27.309395 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d6eef-89b0-410e-aa92-85d914f3ae50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:27.310072 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d6eef-89b0-410e-aa92-85d914f3ae50 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:27.310358 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d6eef-89b0-410e-aa92-85d914f3ae50 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:27.310635 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d6eef-89b0-410e-aa92-85d914f3ae50 None admin] PATH_INFO: `/v3/services` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:27.311349 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d6eef-89b0-410e-aa92-85d914f3ae50 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:27.311657 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d6eef-89b0-410e-aa92-85d914f3ae50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:27.313072 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d6eef-89b0-410e-aa92-85d914f3ae50 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:27.318181 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 381/758] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jul 13 23:35:27 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:35:29.586314 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f4a39-fec9-4882-ba8e-f6bbed603d68 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:29.586819 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f4a39-fec9-4882-ba8e-f6bbed603d68 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:29.586912 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f4a39-fec9-4882-ba8e-f6bbed603d68 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:29.588778 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 378/759] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:35:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:35:29.594075 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79494e34-468f-417a-9d2f-2a8725041d31 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:29.594510 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79494e34-468f-417a-9d2f-2a8725041d31 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:29.594612 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79494e34-468f-417a-9d2f-2a8725041d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:29.610595 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa6a61-e511-456f-b2ee-d7c89c3bd1b0 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:29.610888 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa6a61-e511-456f-b2ee-d7c89c3bd1b0 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:29.611168 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa6a61-e511-456f-b2ee-d7c89c3bd1b0 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:29.611765 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-79494e34-468f-417a-9d2f-2a8725041d31 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:35:29.612488 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 379/760] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 23:35:29.613002 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-79494e34-468f-417a-9d2f-2a8725041d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:35:29.617313 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55ccac-f207-4983-8486-90f27ad3032e None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:29.617603 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55ccac-f207-4983-8486-90f27ad3032e None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:29.617880 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55ccac-f207-4983-8486-90f27ad3032e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:29.634664 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-ac55ccac-f207-4983-8486-90f27ad3032e None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:35:29.636579 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-ac55ccac-f207-4983-8486-90f27ad3032e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:35:29.683394 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 382/761] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:35:29 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 23:35:29.703407 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 380/762] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:35:29 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 23:35:29.707496 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79494e34-468f-417a-9d2f-2a8725041d31 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:29.727175 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac55ccac-f207-4983-8486-90f27ad3032e None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:29.738889 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:29.754947 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:29.809497 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79494e34-468f-417a-9d2f-2a8725041d31 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:29.827903 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac55ccac-f207-4983-8486-90f27ad3032e None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:29.844169 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7ca9b-988d-47ba-9d57-2584aa1c2360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:29.844846 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7ca9b-988d-47ba-9d57-2584aa1c2360 None admin] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:29.845144 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7ca9b-988d-47ba-9d57-2584aa1c2360 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:29.845418 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7ca9b-988d-47ba-9d57-2584aa1c2360 None admin] PATH_INFO: `/v3/services` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:29.846141 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7ca9b-988d-47ba-9d57-2584aa1c2360 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:29.847537 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7ca9b-988d-47ba-9d57-2584aa1c2360 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:29.860861 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 383/763] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jul 13 23:35:29 2022] POST /identity/v3/services => generated 269 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 23:35:29.867872 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f48c37-660e-4934-b112-baf93b30549a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:29.868558 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f48c37-660e-4934-b112-baf93b30549a None admin] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:29.868863 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f48c37-660e-4934-b112-baf93b30549a None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:29.869817 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f48c37-660e-4934-b112-baf93b30549a None admin] PATH_INFO: `/v3/services` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:29.870562 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f48c37-660e-4934-b112-baf93b30549a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:29.871978 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f48c37-660e-4934-b112-baf93b30549a None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:29.886926 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 381/764] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jul 13 23:35:29 2022] POST /identity/v3/services => generated 251 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 23:35:32.106377 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f27791-2653-41cb-ae25-1003866d28a2 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:32.106900 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f27791-2653-41cb-ae25-1003866d28a2 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:32.107020 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f27791-2653-41cb-ae25-1003866d28a2 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:32.108386 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 384/765] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:35:32.113879 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d42d30-1c1e-44ea-be63-5f4fdd8b300a None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:32.114322 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d42d30-1c1e-44ea-be63-5f4fdd8b300a None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:32.114448 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d42d30-1c1e-44ea-be63-5f4fdd8b300a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:32.131746 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-e4d42d30-1c1e-44ea-be63-5f4fdd8b300a None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:35:32.132935 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-e4d42d30-1c1e-44ea-be63-5f4fdd8b300a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:35:32.149073 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684d0e4-fc86-4dcd-9f15-1a67508165af None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:32.149358 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684d0e4-fc86-4dcd-9f15-1a67508165af None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:32.149635 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684d0e4-fc86-4dcd-9f15-1a67508165af None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:32.151216 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 385/766] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 23:35:32.156262 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1cd1a-7693-4691-9c8d-9f982e0400b6 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:32.156535 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1cd1a-7693-4691-9c8d-9f982e0400b6 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:32.156806 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1cd1a-7693-4691-9c8d-9f982e0400b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:32.173464 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-f2c1cd1a-7693-4691-9c8d-9f982e0400b6 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:35:32.174696 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-f2c1cd1a-7693-4691-9c8d-9f982e0400b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:35:32.192398 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:32.212984 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 382/767] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:35:32 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 23:35:32.233608 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d42d30-1c1e-44ea-be63-5f4fdd8b300a None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:32.243193 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 386/768] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:35:32 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 23:35:32.271517 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1cd1a-7693-4691-9c8d-9f982e0400b6 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:32.305149 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:32.339409 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d42d30-1c1e-44ea-be63-5f4fdd8b300a None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:32.374237 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1cd1a-7693-4691-9c8d-9f982e0400b6 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:32.374489 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93700de0-e86d-4c52-9ddc-47113bb03cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:32.375244 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93700de0-e86d-4c52-9ddc-47113bb03cf1 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:32.375522 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93700de0-e86d-4c52-9ddc-47113bb03cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:32.375797 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93700de0-e86d-4c52-9ddc-47113bb03cf1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:32.376447 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93700de0-e86d-4c52-9ddc-47113bb03cf1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:32.378035 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93700de0-e86d-4c52-9ddc-47113bb03cf1 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:32.391350 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-93700de0-e86d-4c52-9ddc-47113bb03cf1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 13 23:35:32.391350 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:32.391350 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 23:35:32.391350 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 23:35:32.391350 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 23:35:32.391350 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 23:35:32.391350 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 23:35:32.391350 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 23:35:32.391350 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 13 23:35:32.391350 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:32.391350 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 23:35:32.391350 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:32.391350 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:32.391350 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:32.391350 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:32.391350 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:32.392370 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:32.392370 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:32.392370 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:32.392370 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:32.392370 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:32.392370 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:32.392370 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:32.392370 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 23:35:32.392370 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 23:35:32.392370 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 23:35:32.392370 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 23:35:32.392370 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:32.392370 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:32.392370 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:32.392370 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:32.392370 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:32.393274 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:32.393274 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:32.393274 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:32.393274 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:32.393274 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:32.393274 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:32.393274 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:32.393274 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:32.393274 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:32.393274 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:32.393274 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:32.393274 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 23:35:32.393274 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 23:35:32.393274 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 13 23:35:32.393274 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:32.393274 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 383/769] 10.222.0.16 () {56 vars in 1132 bytes} [Wed Jul 13 23:35:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 23:35:32.398351 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93700de0-e86d-4c52-9ddc-47113bb03cf1 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:32.412379 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b9108-a676-45be-8242-e436c500680b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:32.413629 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b9108-a676-45be-8242-e436c500680b None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:32.413920 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b9108-a676-45be-8242-e436c500680b None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:32.414245 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b9108-a676-45be-8242-e436c500680b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:32.414905 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b9108-a676-45be-8242-e436c500680b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:32.416788 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b9108-a676-45be-8242-e436c500680b None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:32.428592 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-c39b9108-a676-45be-8242-e436c500680b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 13 23:35:32.428592 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:32.428592 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 23:35:32.428592 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 23:35:32.428592 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 23:35:32.428592 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 23:35:32.428592 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 23:35:32.428592 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 23:35:32.428592 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 13 23:35:32.428592 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:32.428592 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 23:35:32.428592 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:32.428592 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:32.428592 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:32.428592 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:32.428592 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:32.428592 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:32.429736 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:32.429736 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:32.429736 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:32.429736 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:32.429736 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:32.429736 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:32.429736 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 23:35:32.429736 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 23:35:32.429736 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 23:35:32.429736 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 23:35:32.429736 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:32.429736 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:32.429736 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:32.429736 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:32.429736 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:32.429736 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:32.430630 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:32.430630 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:32.430630 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:32.430630 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:32.430630 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:32.430630 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:32.430630 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:32.430630 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:32.430630 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:32.430630 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:32.430630 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 23:35:32.430630 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 23:35:32.430630 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 13 23:35:32.430630 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:32.430630 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 387/770] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jul 13 23:35:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 23:35:32.436243 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b9108-a676-45be-8242-e436c500680b None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:32.463395 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:32.505996 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93700de0-e86d-4c52-9ddc-47113bb03cf1 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:32.534663 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:32.538520 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b9108-a676-45be-8242-e436c500680b None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:32.547202 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe2bf1-927b-4d25-a994-0904e6673181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:32.547861 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe2bf1-927b-4d25-a994-0904e6673181 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:32.548145 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe2bf1-927b-4d25-a994-0904e6673181 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:32.548424 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe2bf1-927b-4d25-a994-0904e6673181 None admin] PATH_INFO: `/v3/services` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:32.549170 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fe2bf1-927b-4d25-a994-0904e6673181 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:32.549476 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fe2bf1-927b-4d25-a994-0904e6673181 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:32.550838 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fe2bf1-927b-4d25-a994-0904e6673181 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:32.555870 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 384/771] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jul 13 23:35:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:35:32.561701 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe2bf1-927b-4d25-a994-0904e6673181 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:32.572766 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34356e7-1cab-46a2-b281-8b64b8b5590a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:32.573458 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34356e7-1cab-46a2-b281-8b64b8b5590a None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:32.573743 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34356e7-1cab-46a2-b281-8b64b8b5590a None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:32.574015 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34356e7-1cab-46a2-b281-8b64b8b5590a None admin] PATH_INFO: `/v3/services` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:32.574706 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34356e7-1cab-46a2-b281-8b64b8b5590a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:32.575008 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34356e7-1cab-46a2-b281-8b64b8b5590a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:32.576350 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34356e7-1cab-46a2-b281-8b64b8b5590a None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:32.581061 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 388/772] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jul 13 23:35:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:35:32.586539 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34356e7-1cab-46a2-b281-8b64b8b5590a None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:32.663981 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe2bf1-927b-4d25-a994-0904e6673181 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:32.683367 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:32.688250 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34356e7-1cab-46a2-b281-8b64b8b5590a None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:32.699961 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16571e5-8df5-41de-a2fa-0ab39f6b2460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:32.700620 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16571e5-8df5-41de-a2fa-0ab39f6b2460 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:32.700938 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16571e5-8df5-41de-a2fa-0ab39f6b2460 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:32.701218 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16571e5-8df5-41de-a2fa-0ab39f6b2460 None admin] PATH_INFO: `/v3/services` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:32.702009 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16571e5-8df5-41de-a2fa-0ab39f6b2460 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:32.702322 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16571e5-8df5-41de-a2fa-0ab39f6b2460 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:32.703676 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16571e5-8df5-41de-a2fa-0ab39f6b2460 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:32.708402 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 385/773] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jul 13 23:35:32 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:35:32.714610 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16571e5-8df5-41de-a2fa-0ab39f6b2460 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:32.721467 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4ba15-fd7d-4672-bad0-a046630888f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:32.722130 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4ba15-fd7d-4672-bad0-a046630888f7 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:32.722415 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4ba15-fd7d-4672-bad0-a046630888f7 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:32.722690 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4ba15-fd7d-4672-bad0-a046630888f7 None admin] PATH_INFO: `/v3/services` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:32.723392 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec4ba15-fd7d-4672-bad0-a046630888f7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:32.723700 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec4ba15-fd7d-4672-bad0-a046630888f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:32.725070 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec4ba15-fd7d-4672-bad0-a046630888f7 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:32.729929 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 389/774] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jul 13 23:35:32 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:32.735786 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4ba15-fd7d-4672-bad0-a046630888f7 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:32.764676 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:32.819871 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16571e5-8df5-41de-a2fa-0ab39f6b2460 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:32.835851 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4ba15-fd7d-4672-bad0-a046630888f7 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:32.853367 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dadb49b-abdd-4862-b2b8-088f4347f9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:32.854094 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dadb49b-abdd-4862-b2b8-088f4347f9b0 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:32.854387 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dadb49b-abdd-4862-b2b8-088f4347f9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:32.854665 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dadb49b-abdd-4862-b2b8-088f4347f9b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:32.855453 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dadb49b-abdd-4862-b2b8-088f4347f9b0 None admin] RBAC: Adding query filter params (interface=public, service_id=0fa26f6d132747a7aa3cd211addbdf54, region_id=RegionOne) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:32.855765 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dadb49b-abdd-4862-b2b8-088f4347f9b0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:32.857160 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dadb49b-abdd-4862-b2b8-088f4347f9b0 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:32.862259 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 386/775] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Jul 13 23:35:32 2022] GET /identity/v3/endpoints?service_id=0fa26f6d132747a7aa3cd211addbdf54&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:35:32.867742 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dadb49b-abdd-4862-b2b8-088f4347f9b0 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:32.869238 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a551c-b620-45ef-af41-6cdad32d22f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:32.870038 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a551c-b620-45ef-af41-6cdad32d22f5 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:32.870321 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a551c-b620-45ef-af41-6cdad32d22f5 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:32.870594 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a551c-b620-45ef-af41-6cdad32d22f5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:32.871370 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a551c-b620-45ef-af41-6cdad32d22f5 None admin] RBAC: Adding query filter params (interface=public, service_id=796125e22cca4f42a6a28eeeaa6e4804, region_id=RegionOne) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:32.871678 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a551c-b620-45ef-af41-6cdad32d22f5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:32.873037 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a551c-b620-45ef-af41-6cdad32d22f5 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:32.878079 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 390/776] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Jul 13 23:35:32 2022] GET /identity/v3/endpoints?service_id=796125e22cca4f42a6a28eeeaa6e4804&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:32.883426 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a551c-b620-45ef-af41-6cdad32d22f5 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:32.919963 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:32.969404 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dadb49b-abdd-4862-b2b8-088f4347f9b0 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:32.973484 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:32.983775 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a551c-b620-45ef-af41-6cdad32d22f5 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:33.004019 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13597f8-64d0-4fe4-8b6a-78ab1e0f8fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:33.004675 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13597f8-64d0-4fe4-8b6a-78ab1e0f8fbc None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:33.004997 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13597f8-64d0-4fe4-8b6a-78ab1e0f8fbc None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:33.005276 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13597f8-64d0-4fe4-8b6a-78ab1e0f8fbc None admin] PATH_INFO: `/v3/services` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:33.005955 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13597f8-64d0-4fe4-8b6a-78ab1e0f8fbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:33.007312 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13597f8-64d0-4fe4-8b6a-78ab1e0f8fbc None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:33.013987 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 387/777] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jul 13 23:35:32 2022] GET /identity/v3/services => generated 1498 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 23:35:33.019435 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82fa10-35d7-4740-8911-c93efe5afc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:33.020222 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82fa10-35d7-4740-8911-c93efe5afc7a None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:33.020576 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82fa10-35d7-4740-8911-c93efe5afc7a None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:33.020989 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82fa10-35d7-4740-8911-c93efe5afc7a None admin] PATH_INFO: `/v3/services` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:33.022383 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82fa10-35d7-4740-8911-c93efe5afc7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:33.023560 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82fa10-35d7-4740-8911-c93efe5afc7a None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:33.033881 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 391/778] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jul 13 23:35:32 2022] GET /identity/v3/services => generated 1498 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 23:35:35.304473 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd919b8-c963-4286-aa80-2e321f16276e None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:35.305056 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd919b8-c963-4286-aa80-2e321f16276e None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:35.305056 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd919b8-c963-4286-aa80-2e321f16276e None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:35.306421 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 388/779] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:35:35.313244 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3bebe1-7a93-4a0a-84bb-4801b99c1940 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:35.313767 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3bebe1-7a93-4a0a-84bb-4801b99c1940 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:35.314274 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3bebe1-7a93-4a0a-84bb-4801b99c1940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:35.314675 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf1a82-7162-49c8-92a7-c17befa88fef None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:35.314968 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf1a82-7162-49c8-92a7-c17befa88fef None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:35.315254 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf1a82-7162-49c8-92a7-c17befa88fef None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:35.316850 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 389/780] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:35:35.321621 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44caec6b-1d0e-428a-9399-6233de60fa79 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:35.321921 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44caec6b-1d0e-428a-9399-6233de60fa79 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:35.322919 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44caec6b-1d0e-428a-9399-6233de60fa79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:35.331780 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-de3bebe1-7a93-4a0a-84bb-4801b99c1940 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:35:35.333002 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-de3bebe1-7a93-4a0a-84bb-4801b99c1940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:35:35.340156 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-44caec6b-1d0e-428a-9399-6233de60fa79 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:35:35.341355 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-44caec6b-1d0e-428a-9399-6233de60fa79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:35:35.404117 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 392/781] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:35:35 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 23:35:35.409242 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 390/782] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:35:35 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 23:35:35.424845 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3bebe1-7a93-4a0a-84bb-4801b99c1940 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:35.434819 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44caec6b-1d0e-428a-9399-6233de60fa79 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:35.478266 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:35.508078 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:35.527194 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3bebe1-7a93-4a0a-84bb-4801b99c1940 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:35.535690 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44caec6b-1d0e-428a-9399-6233de60fa79 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:35.564373 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687f80d1-dc07-4215-b159-35cb49cfb715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:35.565138 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f80d1-dc07-4215-b159-35cb49cfb715 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:35.565421 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f80d1-dc07-4215-b159-35cb49cfb715 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:35.565701 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f80d1-dc07-4215-b159-35cb49cfb715 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:35.566344 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687f80d1-dc07-4215-b159-35cb49cfb715 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:35.567710 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687f80d1-dc07-4215-b159-35cb49cfb715 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:35.572182 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165fa5a8-1a6c-455f-9f85-fb35b1bb1900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:35.573033 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165fa5a8-1a6c-455f-9f85-fb35b1bb1900 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:35.573322 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165fa5a8-1a6c-455f-9f85-fb35b1bb1900 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:35.573600 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165fa5a8-1a6c-455f-9f85-fb35b1bb1900 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:35.574258 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165fa5a8-1a6c-455f-9f85-fb35b1bb1900 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:35.575605 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165fa5a8-1a6c-455f-9f85-fb35b1bb1900 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:35.579592 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-687f80d1-dc07-4215-b159-35cb49cfb715 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 13 23:35:35.579592 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:35.579592 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 23:35:35.579592 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 23:35:35.579592 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 23:35:35.579592 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 23:35:35.579592 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 23:35:35.579592 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 23:35:35.579592 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 13 23:35:35.579592 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:35.579592 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 23:35:35.579592 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:35.579592 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:35.579592 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:35.579592 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:35.579592 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:35.579592 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:35.580813 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:35.580813 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:35.580813 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:35.580813 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:35.580813 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:35.580813 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:35.580813 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 23:35:35.580813 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 23:35:35.580813 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 23:35:35.580813 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 23:35:35.580813 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:35.580813 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:35.580813 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:35.580813 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:35.580813 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:35.580813 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:35.581699 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:35.581699 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:35.581699 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:35.581699 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:35.581699 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:35.581699 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:35.581699 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:35.581699 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:35.581699 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:35.581699 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:35.581699 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 23:35:35.581699 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 23:35:35.581699 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 13 23:35:35.581699 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:35.581699 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 393/783] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jul 13 23:35:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 23:35:35.586453 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687f80d1-dc07-4215-b159-35cb49cfb715 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:35.588923 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-165fa5a8-1a6c-455f-9f85-fb35b1bb1900 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 13 23:35:35.588923 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:35.588923 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 23:35:35.588923 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 23:35:35.588923 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 23:35:35.588923 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 23:35:35.588923 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 23:35:35.588923 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 23:35:35.588923 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 13 23:35:35.588923 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:35.588923 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 23:35:35.588923 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:35.588923 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:35.588923 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:35.588923 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:35.588923 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:35.590129 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:35.590129 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:35.590129 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:35.590129 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:35.590129 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:35.590129 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:35.590129 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:35.590129 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 23:35:35.590129 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 23:35:35.590129 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 23:35:35.590129 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 23:35:35.590129 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:35.590129 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:35.590129 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:35.590129 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:35.590129 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:35.591273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:35.591273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:35.591273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:35.591273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:35.591273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:35.591273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:35.591273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:35.591273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:35.591273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:35.591273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:35.591273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:35.591273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 23:35:35.591273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 23:35:35.591273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 13 23:35:35.591273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:35.592972 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 391/784] 10.222.0.16 () {56 vars in 1132 bytes} [Wed Jul 13 23:35:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 23:35:35.595822 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165fa5a8-1a6c-455f-9f85-fb35b1bb1900 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:35.688220 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687f80d1-dc07-4215-b159-35cb49cfb715 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:35.696352 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165fa5a8-1a6c-455f-9f85-fb35b1bb1900 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:35.703375 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:35.721012 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3af857-bf85-49c3-b1a1-5d6dd2162788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:35.721672 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3af857-bf85-49c3-b1a1-5d6dd2162788 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:35.722016 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3af857-bf85-49c3-b1a1-5d6dd2162788 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:35.722253 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3af857-bf85-49c3-b1a1-5d6dd2162788 None admin] PATH_INFO: `/v3/services` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:35.722949 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3af857-bf85-49c3-b1a1-5d6dd2162788 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:35.723253 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3af857-bf85-49c3-b1a1-5d6dd2162788 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:35.724609 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3af857-bf85-49c3-b1a1-5d6dd2162788 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:35.730384 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 394/785] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jul 13 23:35:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:35:35.732629 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f5b86-355a-427e-8127-d9b4ed641a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:35.733323 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f5b86-355a-427e-8127-d9b4ed641a07 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:35.733607 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f5b86-355a-427e-8127-d9b4ed641a07 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:35.733880 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f5b86-355a-427e-8127-d9b4ed641a07 None admin] PATH_INFO: `/v3/services` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:35.734576 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f5b86-355a-427e-8127-d9b4ed641a07 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:35.734877 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f5b86-355a-427e-8127-d9b4ed641a07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:35.736040 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3af857-bf85-49c3-b1a1-5d6dd2162788 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:35.736375 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f5b86-355a-427e-8127-d9b4ed641a07 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:35.741271 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 392/786] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jul 13 23:35:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:35:35.747519 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f5b86-355a-427e-8127-d9b4ed641a07 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:35.751822 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:35.834831 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3af857-bf85-49c3-b1a1-5d6dd2162788 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:35.845126 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f5b86-355a-427e-8127-d9b4ed641a07 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:35.867601 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032df42f-bbb4-468f-b444-52ca7778b49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:35.868255 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032df42f-bbb4-468f-b444-52ca7778b49b None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:35.868537 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032df42f-bbb4-468f-b444-52ca7778b49b None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:35.868808 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032df42f-bbb4-468f-b444-52ca7778b49b None admin] PATH_INFO: `/v3/services` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:35.870167 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032df42f-bbb4-468f-b444-52ca7778b49b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:35.870475 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032df42f-bbb4-468f-b444-52ca7778b49b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:35.871823 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032df42f-bbb4-468f-b444-52ca7778b49b None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:35.876611 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 395/787] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jul 13 23:35:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:35:35.882344 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032df42f-bbb4-468f-b444-52ca7778b49b None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:35.883161 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc526f41-a4ef-483f-a708-1327a20e8267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:35.883833 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc526f41-a4ef-483f-a708-1327a20e8267 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:35.884122 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc526f41-a4ef-483f-a708-1327a20e8267 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:35.884402 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc526f41-a4ef-483f-a708-1327a20e8267 None admin] PATH_INFO: `/v3/services` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:35.885304 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc526f41-a4ef-483f-a708-1327a20e8267 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:35.885615 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc526f41-a4ef-483f-a708-1327a20e8267 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:35.887006 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc526f41-a4ef-483f-a708-1327a20e8267 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:35.892198 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 393/788] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jul 13 23:35:35 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:35:35.898015 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc526f41-a4ef-483f-a708-1327a20e8267 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:35.931242 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:35.962955 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:35.985662 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032df42f-bbb4-468f-b444-52ca7778b49b None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:35.997549 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc526f41-a4ef-483f-a708-1327a20e8267 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:36.019023 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d594452-9bd9-4fde-b1d3-197e65c58260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:36.019674 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d594452-9bd9-4fde-b1d3-197e65c58260 None admin] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:36.019961 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d594452-9bd9-4fde-b1d3-197e65c58260 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:36.020235 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d594452-9bd9-4fde-b1d3-197e65c58260 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:36.021013 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d594452-9bd9-4fde-b1d3-197e65c58260 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:36.022368 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d594452-9bd9-4fde-b1d3-197e65c58260 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:36.031194 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2604d662-de33-49b9-b310-d9c529f759c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:36.031856 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604d662-de33-49b9-b310-d9c529f759c1 None admin] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:36.032134 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604d662-de33-49b9-b310-d9c529f759c1 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:36.032416 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604d662-de33-49b9-b310-d9c529f759c1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:36.033180 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2604d662-de33-49b9-b310-d9c529f759c1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:36.034625 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2604d662-de33-49b9-b310-d9c529f759c1 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:36.040396 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 396/789] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 13 23:35:35 2022] POST /identity/v3/endpoints => generated 346 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 23:35:36.060229 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 394/790] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 13 23:35:35 2022] POST /identity/v3/endpoints => generated 347 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 23:35:38.329646 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1e0db-68b9-4db6-a2e2-2c8812f5b20b None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:38.330200 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1e0db-68b9-4db6-a2e2-2c8812f5b20b None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:38.330200 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1e0db-68b9-4db6-a2e2-2c8812f5b20b None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:38.331527 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 397/791] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:35:38.336813 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48efc0-17ae-4c2b-a350-39c70ef4633a None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:38.337222 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48efc0-17ae-4c2b-a350-39c70ef4633a None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:38.337394 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48efc0-17ae-4c2b-a350-39c70ef4633a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:38.354400 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-2d48efc0-17ae-4c2b-a350-39c70ef4633a None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:35:38.355621 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-2d48efc0-17ae-4c2b-a350-39c70ef4633a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:35:38.395843 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707e747-8908-4278-9b9e-49071af520e8 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:38.396128 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707e747-8908-4278-9b9e-49071af520e8 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:38.396403 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707e747-8908-4278-9b9e-49071af520e8 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:38.397780 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 398/792] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 23:35:38.403397 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48823e7-4533-4000-8b9c-ff95f6250cb2 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:38.403680 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48823e7-4533-4000-8b9c-ff95f6250cb2 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:38.403956 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48823e7-4533-4000-8b9c-ff95f6250cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:38.420225 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-d48823e7-4533-4000-8b9c-ff95f6250cb2 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:35:38.421431 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-d48823e7-4533-4000-8b9c-ff95f6250cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:35:38.433131 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 395/793] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:35:38 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 23:35:38.456919 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d48efc0-17ae-4c2b-a350-39c70ef4633a None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:38.473588 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:38.488863 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 399/794] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:35:38 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 23:35:38.513569 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48823e7-4533-4000-8b9c-ff95f6250cb2 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:38.566851 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d48efc0-17ae-4c2b-a350-39c70ef4633a None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:38.580103 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:38.601667 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb5c8e-4e5d-4da4-9d84-37d083895202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:38.602458 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb5c8e-4e5d-4da4-9d84-37d083895202 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:38.602743 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb5c8e-4e5d-4da4-9d84-37d083895202 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:38.603020 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb5c8e-4e5d-4da4-9d84-37d083895202 None admin] PATH_INFO: `/v3/services/compute` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:38.604287 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb5c8e-4e5d-4da4-9d84-37d083895202 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:38.605701 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb5c8e-4e5d-4da4-9d84-37d083895202 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:38.617677 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-03cb5c8e-4e5d-4da4-9d84-37d083895202 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 13 23:35:38.617677 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:38.617677 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 23:35:38.617677 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 23:35:38.617677 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 23:35:38.617677 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 23:35:38.617677 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 23:35:38.617677 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 23:35:38.617677 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 13 23:35:38.617677 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:38.617677 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 23:35:38.617677 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:38.617677 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:38.617677 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:38.617677 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:38.617677 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:38.617677 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:38.618735 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:38.618735 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:38.618735 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:38.618735 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:38.618735 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:38.618735 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:38.618735 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 23:35:38.618735 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 23:35:38.618735 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 23:35:38.618735 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 23:35:38.618735 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:38.618735 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:38.618735 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:38.618735 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:38.618735 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:38.618735 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:38.619602 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:38.619602 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:38.619602 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:38.619602 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:38.619602 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:38.619602 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:38.619602 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:38.619602 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:38.619602 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:38.619602 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:38.619602 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 23:35:38.619602 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 23:35:38.619602 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 13 23:35:38.619602 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:38.619602 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 396/795] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 13 23:35:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 23:35:38.621489 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48823e7-4533-4000-8b9c-ff95f6250cb2 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:38.624681 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb5c8e-4e5d-4da4-9d84-37d083895202 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:38.656766 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1124784-46fd-43b6-823d-e7ff2bc36613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:38.657451 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1124784-46fd-43b6-823d-e7ff2bc36613 None admin] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:38.657737 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1124784-46fd-43b6-823d-e7ff2bc36613 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:38.658013 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1124784-46fd-43b6-823d-e7ff2bc36613 None admin] PATH_INFO: `/v3/projects` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:38.658709 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1124784-46fd-43b6-823d-e7ff2bc36613 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:38.660142 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1124784-46fd-43b6-823d-e7ff2bc36613 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:38.661522 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: WARNING keystone.server.flask.common [None req-d1124784-46fd-43b6-823d-e7ff2bc36613 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 13 23:35:38.678810 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.sql.core [None req-d1124784-46fd-43b6-823d-e7ff2bc36613 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 13 23:35:38.678810 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 13 23:35:38.678810 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [parameters: {'id': 'c7d04eb9784e41d3b67360e510b7c6c0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 13 23:35:38.678810 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=98935) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 13 23:35:38.695251 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-d1124784-46fd-43b6-823d-e7ff2bc36613 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c7d04eb9784e41d3b67360e510b7c6c0.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c7d04eb9784e41d3b67360e510b7c6c0. Jul 13 23:35:38.695251 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:38.695251 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 13 23:35:38.695251 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 13 23:35:38.695251 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 13 23:35:38.695251 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 13 23:35:38.695251 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 13 23:35:38.695251 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application result = self._query(query) Jul 13 23:35:38.695251 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 13 23:35:38.695251 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application conn.query(q) Jul 13 23:35:38.695251 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 13 23:35:38.695251 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 13 23:35:38.695251 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 13 23:35:38.696115 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application result.read() Jul 13 23:35:38.696115 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 13 23:35:38.696115 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 13 23:35:38.696115 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 13 23:35:38.696115 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 13 23:35:38.696115 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 13 23:35:38.696115 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 13 23:35:38.696115 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 13 23:35:38.696115 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 13 23:35:38.696115 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 13 23:35:38.696115 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:38.696115 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 13 23:35:38.696115 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:38.696115 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:38.696115 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 13 23:35:38.696115 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 13 23:35:38.696115 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 13 23:35:38.696115 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 13 23:35:38.697375 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 13 23:35:38.697375 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application next(self.gen) Jul 13 23:35:38.697375 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 13 23:35:38.697375 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application yield resource Jul 13 23:35:38.697375 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 13 23:35:38.697375 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application next(self.gen) Jul 13 23:35:38.697375 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 13 23:35:38.697375 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application self.session.rollback() Jul 13 23:35:38.697375 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 13 23:35:38.697375 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application self.force_reraise() Jul 13 23:35:38.697375 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 13 23:35:38.697375 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise self.value Jul 13 23:35:38.697375 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 13 23:35:38.697375 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 13 23:35:38.697375 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 13 23:35:38.697375 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application session.commit() Jul 13 23:35:38.697375 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 13 23:35:38.698909 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 13 23:35:38.698909 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 13 23:35:38.698909 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application self._prepare_impl() Jul 13 23:35:38.698909 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 13 23:35:38.698909 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application self.session.flush() Jul 13 23:35:38.698909 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 13 23:35:38.698909 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application self._flush(objects) Jul 13 23:35:38.698909 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 13 23:35:38.698909 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 13 23:35:38.698909 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 13 23:35:38.698909 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application compat.raise_( Jul 13 23:35:38.698909 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 13 23:35:38.698909 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception Jul 13 23:35:38.698909 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 13 23:35:38.698909 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application flush_context.execute() Jul 13 23:35:38.698909 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 13 23:35:38.698909 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rec.execute(self) Jul 13 23:35:38.700148 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 13 23:35:38.700148 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 13 23:35:38.700148 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 13 23:35:38.700148 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 13 23:35:38.700148 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 13 23:35:38.700148 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 13 23:35:38.700148 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 13 23:35:38.700148 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 13 23:35:38.700148 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 13 23:35:38.700148 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 13 23:35:38.700148 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 13 23:35:38.700148 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 13 23:35:38.700148 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 13 23:35:38.700148 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 13 23:35:38.700148 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 13 23:35:38.701471 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 13 23:35:38.701471 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 13 23:35:38.701471 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception Jul 13 23:35:38.701471 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 13 23:35:38.701471 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 13 23:35:38.701471 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 13 23:35:38.701471 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 13 23:35:38.701471 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 13 23:35:38.701471 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application result = self._query(query) Jul 13 23:35:38.701471 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 13 23:35:38.701471 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application conn.query(q) Jul 13 23:35:38.701471 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 13 23:35:38.701471 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 13 23:35:38.701471 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 13 23:35:38.701471 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application result.read() Jul 13 23:35:38.701471 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 13 23:35:38.701471 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 13 23:35:38.702690 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 13 23:35:38.702690 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 13 23:35:38.702690 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 13 23:35:38.702690 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 13 23:35:38.702690 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 13 23:35:38.702690 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 13 23:35:38.702690 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 13 23:35:38.702690 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 13 23:35:38.702690 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [parameters: {'id': 'c7d04eb9784e41d3b67360e510b7c6c0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 13 23:35:38.702690 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 13 23:35:38.702690 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:38.702690 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 23:35:38.702690 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:38.702690 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:38.702690 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 13 23:35:38.703819 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 13 23:35:38.703819 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 13 23:35:38.703819 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 13 23:35:38.703819 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 13 23:35:38.703819 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:38.703819 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 23:35:38.703819 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:38.703819 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:38.703819 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:38.703819 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:38.703819 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:38.703819 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:38.703819 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:38.703819 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:38.703819 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:38.703819 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:38.703819 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:38.705016 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:38.705016 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 13 23:35:38.705016 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 13 23:35:38.705016 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:38.705016 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:38.705016 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 13 23:35:38.705016 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 13 23:35:38.705016 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c7d04eb9784e41d3b67360e510b7c6c0. Jul 13 23:35:38.705016 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:38.705016 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 400/796] 10.222.0.16 () {60 vars in 1140 bytes} [Wed Jul 13 23:35:38 2022] POST /identity/v3/projects => generated 262 bytes in 183 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:38.705016 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1124784-46fd-43b6-823d-e7ff2bc36613 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:38.706177 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:38.726020 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb5c8e-4e5d-4da4-9d84-37d083895202 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:38.760077 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486ce8b-24a2-4552-a6ae-729f3c12a73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:38.760733 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486ce8b-24a2-4552-a6ae-729f3c12a73e None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:38.761048 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486ce8b-24a2-4552-a6ae-729f3c12a73e None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:38.761334 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486ce8b-24a2-4552-a6ae-729f3c12a73e None admin] PATH_INFO: `/v3/services` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:38.762026 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486ce8b-24a2-4552-a6ae-729f3c12a73e None admin] RBAC: Adding query filter params (name=compute) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:38.762598 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486ce8b-24a2-4552-a6ae-729f3c12a73e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:38.763957 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486ce8b-24a2-4552-a6ae-729f3c12a73e None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:38.768542 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 397/797] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jul 13 23:35:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:35:38.774117 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486ce8b-24a2-4552-a6ae-729f3c12a73e None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:38.805035 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1124784-46fd-43b6-823d-e7ff2bc36613 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:38.823816 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:38.841579 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c41664-4034-42e0-a9fa-28d231874c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:38.842307 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c41664-4034-42e0-a9fa-28d231874c2f None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:38.842594 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c41664-4034-42e0-a9fa-28d231874c2f None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:38.842873 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c41664-4034-42e0-a9fa-28d231874c2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:38.849482 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c41664-4034-42e0-a9fa-28d231874c2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:38.851105 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c41664-4034-42e0-a9fa-28d231874c2f None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:38.866002 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-f5c41664-4034-42e0-a9fa-28d231874c2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 23:35:38.866002 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:38.866002 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:38.866002 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:38.866002 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:38.866002 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:38.866002 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:38.866002 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:38.866002 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:38.866002 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:38.866002 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:38.866002 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:38.866002 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 23:35:38.866002 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 23:35:38.866002 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 23:35:38.866891 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 23:35:38.866891 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:38.866891 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:38.866891 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:38.866891 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:38.866891 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:38.866891 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:38.866891 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:38.866891 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:38.866891 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:38.866891 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:38.866891 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:38.866891 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:38.866891 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:38.866891 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:38.866891 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:38.866891 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:38.867786 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 23:35:38.867786 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 23:35:38.867786 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 23:35:38.867786 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 23:35:38.867786 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 23:35:38.867786 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 23:35:38.867786 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 23:35:38.867786 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:38.867786 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 401/798] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 13 23:35:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:38.872984 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c41664-4034-42e0-a9fa-28d231874c2f None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:38.875600 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486ce8b-24a2-4552-a6ae-729f3c12a73e None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:38.909837 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27084d2d-8413-451f-b436-6b5f2cc98e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:38.910521 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27084d2d-8413-451f-b436-6b5f2cc98e99 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:38.910810 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27084d2d-8413-451f-b436-6b5f2cc98e99 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:38.911091 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27084d2d-8413-451f-b436-6b5f2cc98e99 None admin] PATH_INFO: `/v3/services` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:38.911804 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27084d2d-8413-451f-b436-6b5f2cc98e99 None admin] RBAC: Adding query filter params (type=compute) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:38.912115 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27084d2d-8413-451f-b436-6b5f2cc98e99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:38.913525 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27084d2d-8413-451f-b436-6b5f2cc98e99 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:38.918723 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 398/799] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jul 13 23:35:38 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:35:38.976783 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c41664-4034-42e0-a9fa-28d231874c2f None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:39.014753 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd90f7-e71d-4e0c-ad97-51009a781335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:39.015433 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd90f7-e71d-4e0c-ad97-51009a781335 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:39.015721 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd90f7-e71d-4e0c-ad97-51009a781335 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:39.016002 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd90f7-e71d-4e0c-ad97-51009a781335 None admin] PATH_INFO: `/v3/projects` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:39.016774 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd90f7-e71d-4e0c-ad97-51009a781335 None admin] RBAC: Adding query filter params (name=service) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:39.017178 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd90f7-e71d-4e0c-ad97-51009a781335 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:39.018622 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd90f7-e71d-4e0c-ad97-51009a781335 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:39.040968 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 402/800] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jul 13 23:35:38 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:35:41.164237 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce5df6-d1f9-436f-9fce-57f39ab9fa90 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:41.164786 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce5df6-d1f9-436f-9fce-57f39ab9fa90 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:41.164786 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce5df6-d1f9-436f-9fce-57f39ab9fa90 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:41.166797 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 399/801] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:35:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:35:41.173116 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f772a3-edb2-4966-b1ef-b42bdf75630e None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:41.173646 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f772a3-edb2-4966-b1ef-b42bdf75630e None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:41.173738 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f772a3-edb2-4966-b1ef-b42bdf75630e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:41.192427 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-e1f772a3-edb2-4966-b1ef-b42bdf75630e None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:35:41.194016 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-e1f772a3-edb2-4966-b1ef-b42bdf75630e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:35:41.223584 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:41.267312 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 403/802] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:35:41 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 23:35:41.290556 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce5df6-d1f9-436f-9fce-57f39ab9fa90 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:41.302423 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:41.328130 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b6748-80d2-481f-af59-1f61d56c2f9f None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:41.328424 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b6748-80d2-481f-af59-1f61d56c2f9f None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:41.328714 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b6748-80d2-481f-af59-1f61d56c2f9f None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:41.330104 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 404/803] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:35:41.334882 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f071e6-a45d-4ec8-b561-80571fee55a7 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:41.335167 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f071e6-a45d-4ec8-b561-80571fee55a7 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:41.335445 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f071e6-a45d-4ec8-b561-80571fee55a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:41.352900 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-e2f071e6-a45d-4ec8-b561-80571fee55a7 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:35:41.354227 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-e2f071e6-a45d-4ec8-b561-80571fee55a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:35:41.393885 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce5df6-d1f9-436f-9fce-57f39ab9fa90 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:41.419563 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 405/804] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:35:41 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 23:35:41.427974 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64804904-3dce-4c35-8911-ee23aa73c9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:41.428630 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64804904-3dce-4c35-8911-ee23aa73c9d8 None admin] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:41.428939 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64804904-3dce-4c35-8911-ee23aa73c9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:41.429219 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64804904-3dce-4c35-8911-ee23aa73c9d8 None admin] PATH_INFO: `/v3/services` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:41.429959 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64804904-3dce-4c35-8911-ee23aa73c9d8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:41.431974 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64804904-3dce-4c35-8911-ee23aa73c9d8 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:41.444976 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 400/805] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jul 13 23:35:41 2022] POST /identity/v3/services => generated 242 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 23:35:41.445386 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f071e6-a45d-4ec8-b561-80571fee55a7 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:41.550667 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:41.554898 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f071e6-a45d-4ec8-b561-80571fee55a7 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:41.598631 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae75adc-c5ff-4d91-bf1a-39d44002e827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:41.599307 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae75adc-c5ff-4d91-bf1a-39d44002e827 None admin] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:41.599586 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae75adc-c5ff-4d91-bf1a-39d44002e827 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:41.599859 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae75adc-c5ff-4d91-bf1a-39d44002e827 None admin] PATH_INFO: `/v3/users` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:41.600559 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae75adc-c5ff-4d91-bf1a-39d44002e827 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:41.602067 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae75adc-c5ff-4d91-bf1a-39d44002e827 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:41.616907 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.sql.core [None req-5ae75adc-c5ff-4d91-bf1a-39d44002e827 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 13 23:35:41.616907 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 13 23:35:41.616907 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [parameters: {'user_id': 'abe7ce6f372144fda95c8fdcd5c54b2d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 13 23:35:41.616907 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=98935) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 13 23:35:41.624640 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-5ae75adc-c5ff-4d91-bf1a-39d44002e827 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 13 23:35:41.624640 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:41.624640 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 13 23:35:41.624640 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 13 23:35:41.624640 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 13 23:35:41.624640 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 13 23:35:41.624640 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 13 23:35:41.624640 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application result = self._query(query) Jul 13 23:35:41.624640 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 13 23:35:41.624640 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application conn.query(q) Jul 13 23:35:41.624640 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 13 23:35:41.624640 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 13 23:35:41.624640 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 13 23:35:41.624640 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application result.read() Jul 13 23:35:41.624640 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 13 23:35:41.625761 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 13 23:35:41.625761 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 13 23:35:41.625761 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 13 23:35:41.625761 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 13 23:35:41.625761 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 13 23:35:41.625761 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 13 23:35:41.625761 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 13 23:35:41.625761 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 13 23:35:41.625761 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:41.625761 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 13 23:35:41.625761 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:41.625761 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:41.625761 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 13 23:35:41.625761 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 13 23:35:41.625761 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 13 23:35:41.625761 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 13 23:35:41.625761 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 13 23:35:41.625761 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application next(self.gen) Jul 13 23:35:41.626963 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 13 23:35:41.626963 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application yield resource Jul 13 23:35:41.626963 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 13 23:35:41.626963 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application next(self.gen) Jul 13 23:35:41.626963 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 13 23:35:41.626963 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application self.session.rollback() Jul 13 23:35:41.626963 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 13 23:35:41.626963 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application self.force_reraise() Jul 13 23:35:41.626963 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 13 23:35:41.626963 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise self.value Jul 13 23:35:41.626963 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 13 23:35:41.626963 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 13 23:35:41.626963 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 13 23:35:41.626963 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application session.commit() Jul 13 23:35:41.626963 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 13 23:35:41.626963 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 13 23:35:41.626963 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 13 23:35:41.628059 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application self._prepare_impl() Jul 13 23:35:41.628059 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 13 23:35:41.628059 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application self.session.flush() Jul 13 23:35:41.628059 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 13 23:35:41.628059 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application self._flush(objects) Jul 13 23:35:41.628059 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 13 23:35:41.628059 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 13 23:35:41.628059 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 13 23:35:41.628059 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application compat.raise_( Jul 13 23:35:41.628059 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 13 23:35:41.628059 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception Jul 13 23:35:41.628059 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 13 23:35:41.628059 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application flush_context.execute() Jul 13 23:35:41.628059 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 13 23:35:41.628059 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rec.execute(self) Jul 13 23:35:41.628059 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 13 23:35:41.628059 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 13 23:35:41.630018 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 13 23:35:41.630018 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 13 23:35:41.630018 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 13 23:35:41.630018 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 13 23:35:41.630018 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 13 23:35:41.630018 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 13 23:35:41.630018 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 13 23:35:41.630018 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 13 23:35:41.630018 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 13 23:35:41.630018 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 13 23:35:41.630018 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 13 23:35:41.630018 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 13 23:35:41.630018 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 13 23:35:41.630018 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 13 23:35:41.630018 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 13 23:35:41.630018 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception Jul 13 23:35:41.631314 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 13 23:35:41.631314 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 13 23:35:41.631314 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 13 23:35:41.631314 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 13 23:35:41.631314 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 13 23:35:41.631314 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application result = self._query(query) Jul 13 23:35:41.631314 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 13 23:35:41.631314 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application conn.query(q) Jul 13 23:35:41.631314 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 13 23:35:41.631314 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 13 23:35:41.631314 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 13 23:35:41.631314 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application result.read() Jul 13 23:35:41.631314 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 13 23:35:41.631314 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 13 23:35:41.631314 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 13 23:35:41.631314 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 13 23:35:41.632359 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 13 23:35:41.632359 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 13 23:35:41.632359 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 13 23:35:41.632359 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 13 23:35:41.632359 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 13 23:35:41.632359 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 13 23:35:41.632359 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [parameters: {'user_id': 'abe7ce6f372144fda95c8fdcd5c54b2d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 13 23:35:41.632359 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 13 23:35:41.632359 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:41.632359 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 23:35:41.632359 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:41.632359 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:41.632359 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:41.632359 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:41.632359 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:41.633560 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:41.633560 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:41.633560 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:41.633560 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:41.633560 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:41.633560 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:41.633560 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:41.633560 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 13 23:35:41.633560 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 13 23:35:41.633560 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:41.633560 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:41.633560 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 23:35:41.633560 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 23:35:41.633560 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 23:35:41.633560 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 23:35:41.633560 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 13 23:35:41.633560 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 13 23:35:41.635590 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 13 23:35:41.635590 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 13 23:35:41.635590 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 13 23:35:41.635590 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 13 23:35:41.635590 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 13 23:35:41.635590 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:41.635590 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 406/806] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Jul 13 23:35:41 2022] POST /identity/v3/users => generated 160 bytes in 181 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 13 23:35:41.636217 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64804904-3dce-4c35-8911-ee23aa73c9d8 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:41.701344 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:41.737128 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64804904-3dce-4c35-8911-ee23aa73c9d8 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:41.770913 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81041f-d67e-4c35-8e56-43527bb8760d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:41.771699 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81041f-d67e-4c35-8e56-43527bb8760d None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:41.771977 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81041f-d67e-4c35-8e56-43527bb8760d None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:41.772248 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81041f-d67e-4c35-8e56-43527bb8760d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:41.779951 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81041f-d67e-4c35-8e56-43527bb8760d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:41.781421 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81041f-d67e-4c35-8e56-43527bb8760d None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:41.796287 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-fa81041f-d67e-4c35-8e56-43527bb8760d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 13 23:35:41.796287 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:41.796287 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:41.796287 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:41.796287 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:41.796287 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:41.796287 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:41.796287 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:41.796287 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:41.796287 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:41.796287 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:41.796287 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:41.796287 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 23:35:41.796287 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 23:35:41.796287 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 23:35:41.796287 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 23:35:41.797398 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:41.797398 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:41.797398 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 23:35:41.797398 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 23:35:41.797398 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 23:35:41.797398 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 23:35:41.797398 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:41.797398 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:41.797398 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:41.797398 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:41.797398 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:41.797398 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:41.797398 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:41.797398 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:41.797398 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:41.797398 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:41.797398 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:41.797398 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:41.798333 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:41.798333 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:41.798333 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 23:35:41.798333 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 23:35:41.798333 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 23:35:41.798333 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 23:35:41.798333 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 23:35:41.798333 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 23:35:41.798333 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 13 23:35:41.798333 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:41.798333 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 401/807] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:35:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:41.803388 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae75adc-c5ff-4d91-bf1a-39d44002e827 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:41.902660 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae75adc-c5ff-4d91-bf1a-39d44002e827 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:41.936117 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d8789-499e-4a23-8541-7022a83eed7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:41.936781 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d8789-499e-4a23-8541-7022a83eed7c None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:41.937094 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d8789-499e-4a23-8541-7022a83eed7c None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:41.937372 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d8789-499e-4a23-8541-7022a83eed7c None admin] PATH_INFO: `/v3/users` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:41.938159 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d8789-499e-4a23-8541-7022a83eed7c None admin] RBAC: Adding query filter params (name=cinder) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:41.938463 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d8789-499e-4a23-8541-7022a83eed7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:41.940073 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d8789-499e-4a23-8541-7022a83eed7c None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:41.977801 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 407/808] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 13 23:35:41 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:43.712180 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f93835-d480-429d-9c84-ae3e148bdd9f None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:43.713237 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f93835-d480-429d-9c84-ae3e148bdd9f None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:43.713423 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f93835-d480-429d-9c84-ae3e148bdd9f None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:43.714775 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 402/809] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:35:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:35:43.720047 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f87fb9-df1c-4645-a0e7-8e414c37223e None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:43.720458 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f87fb9-df1c-4645-a0e7-8e414c37223e None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:43.720618 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f87fb9-df1c-4645-a0e7-8e414c37223e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:43.737998 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-95f87fb9-df1c-4645-a0e7-8e414c37223e None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:35:43.739499 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-95f87fb9-df1c-4645-a0e7-8e414c37223e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:35:43.748684 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:43.806350 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 408/810] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:35:43 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 23:35:43.830000 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f93835-d480-429d-9c84-ae3e148bdd9f None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:43.928177 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f93835-d480-429d-9c84-ae3e148bdd9f None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:43.953240 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:43.960957 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb46bf8-e601-417a-8895-d1f8d51a7be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:43.961730 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb46bf8-e601-417a-8895-d1f8d51a7be8 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:43.962011 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb46bf8-e601-417a-8895-d1f8d51a7be8 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:43.962281 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb46bf8-e601-417a-8895-d1f8d51a7be8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:43.963540 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb46bf8-e601-417a-8895-d1f8d51a7be8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:43.964918 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb46bf8-e601-417a-8895-d1f8d51a7be8 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:43.976357 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-2bb46bf8-e601-417a-8895-d1f8d51a7be8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 13 23:35:43.976357 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:43.976357 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 23:35:43.976357 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 23:35:43.976357 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 23:35:43.976357 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 23:35:43.976357 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 23:35:43.976357 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 23:35:43.976357 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 13 23:35:43.976357 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:43.976357 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 23:35:43.976357 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:43.976357 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:43.976357 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:43.976357 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:43.976357 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:43.976357 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:43.977399 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:43.977399 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:43.977399 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:43.977399 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:43.977399 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:43.977399 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:43.977399 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 23:35:43.977399 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 23:35:43.977399 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 23:35:43.977399 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 23:35:43.977399 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:43.977399 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:43.977399 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:43.977399 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:43.977399 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:43.977399 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:43.979150 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:43.979150 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:43.979150 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:43.979150 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:43.979150 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:43.979150 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:43.979150 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:43.979150 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:43.979150 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:43.979150 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:43.979150 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 23:35:43.979150 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 23:35:43.979150 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 13 23:35:43.979150 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:35:43.979150 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 403/811] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 13 23:35:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:43.983944 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f87fb9-df1c-4645-a0e7-8e414c37223e None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:44.084359 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f87fb9-df1c-4645-a0e7-8e414c37223e None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:44.118631 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be92ba-26e2-4919-a00d-3e51db9bd444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:44.119874 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be92ba-26e2-4919-a00d-3e51db9bd444 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:44.120158 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be92ba-26e2-4919-a00d-3e51db9bd444 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:44.120434 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be92ba-26e2-4919-a00d-3e51db9bd444 None admin] PATH_INFO: `/v3/services` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:44.121159 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8be92ba-26e2-4919-a00d-3e51db9bd444 None admin] RBAC: Adding query filter params (name=compute) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:44.121468 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8be92ba-26e2-4919-a00d-3e51db9bd444 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:44.122833 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8be92ba-26e2-4919-a00d-3e51db9bd444 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:44.127540 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 409/812] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jul 13 23:35:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:44.133228 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb46bf8-e601-417a-8895-d1f8d51a7be8 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:44.230068 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb46bf8-e601-417a-8895-d1f8d51a7be8 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:44.262614 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d4a9b-ab95-4504-94a1-854baf20ce0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:44.263254 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d4a9b-ab95-4504-94a1-854baf20ce0c None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:44.263539 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d4a9b-ab95-4504-94a1-854baf20ce0c None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:44.263815 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d4a9b-ab95-4504-94a1-854baf20ce0c None admin] PATH_INFO: `/v3/services` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:44.264515 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d4a9b-ab95-4504-94a1-854baf20ce0c None admin] RBAC: Adding query filter params (type=compute) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:44.264839 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d4a9b-ab95-4504-94a1-854baf20ce0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:44.266212 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d4a9b-ab95-4504-94a1-854baf20ce0c None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:44.271235 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 404/813] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jul 13 23:35:44 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:44.277842 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be92ba-26e2-4919-a00d-3e51db9bd444 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:44.288481 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:44.376918 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be92ba-26e2-4919-a00d-3e51db9bd444 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:44.414660 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66596684-a51b-474d-bfe4-eeeab89a7704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:44.415697 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66596684-a51b-474d-bfe4-eeeab89a7704 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:44.415855 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66596684-a51b-474d-bfe4-eeeab89a7704 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:44.416101 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66596684-a51b-474d-bfe4-eeeab89a7704 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:44.416894 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66596684-a51b-474d-bfe4-eeeab89a7704 None admin] RBAC: Adding query filter params (interface=public, service_id=360e3838618c4b6c8aae1c2895f5b9b4, region_id=RegionOne) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:44.417205 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66596684-a51b-474d-bfe4-eeeab89a7704 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:44.418667 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66596684-a51b-474d-bfe4-eeeab89a7704 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:44.424296 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 410/814] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Jul 13 23:35:44 2022] GET /identity/v3/endpoints?service_id=360e3838618c4b6c8aae1c2895f5b9b4&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:44.430285 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d4a9b-ab95-4504-94a1-854baf20ce0c None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:44.486513 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:44.530513 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d4a9b-ab95-4504-94a1-854baf20ce0c None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:44.563331 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204039a-81c8-48f0-bf9b-0c53a3f3fde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:44.563983 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204039a-81c8-48f0-bf9b-0c53a3f3fde7 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:44.564266 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204039a-81c8-48f0-bf9b-0c53a3f3fde7 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:44.564544 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204039a-81c8-48f0-bf9b-0c53a3f3fde7 None admin] PATH_INFO: `/v3/services` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:44.565249 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3204039a-81c8-48f0-bf9b-0c53a3f3fde7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:44.566613 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3204039a-81c8-48f0-bf9b-0c53a3f3fde7 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:44.573283 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 405/815] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jul 13 23:35:44 2022] GET /identity/v3/services => generated 1728 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 23:35:46.786624 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232e802-54e5-48bf-aa25-4e3f0275aef4 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:46.787167 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232e802-54e5-48bf-aa25-4e3f0275aef4 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:46.787167 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232e802-54e5-48bf-aa25-4e3f0275aef4 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:46.788539 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 411/816] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:35:46.793741 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ecdde1-8022-4484-9101-66256b3aea09 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:46.794116 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ecdde1-8022-4484-9101-66256b3aea09 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:46.794251 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ecdde1-8022-4484-9101-66256b3aea09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:46.811441 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-35ecdde1-8022-4484-9101-66256b3aea09 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:35:46.812634 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-35ecdde1-8022-4484-9101-66256b3aea09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:35:46.877249 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 406/817] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:35:46 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 23:35:46.902897 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e232e802-54e5-48bf-aa25-4e3f0275aef4 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:46.971503 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:47.001350 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e232e802-54e5-48bf-aa25-4e3f0275aef4 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:47.034296 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341dbb63-0438-4999-928c-6e0739a39e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:47.035067 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341dbb63-0438-4999-928c-6e0739a39e3f None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:47.035349 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341dbb63-0438-4999-928c-6e0739a39e3f None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:47.035618 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341dbb63-0438-4999-928c-6e0739a39e3f None admin] PATH_INFO: `/v3/services/compute` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:47.036253 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341dbb63-0438-4999-928c-6e0739a39e3f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:47.037628 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341dbb63-0438-4999-928c-6e0739a39e3f None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:47.049282 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-341dbb63-0438-4999-928c-6e0739a39e3f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 13 23:35:47.049282 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:47.049282 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 23:35:47.049282 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 23:35:47.049282 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 23:35:47.049282 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 23:35:47.049282 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 23:35:47.049282 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 23:35:47.049282 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 13 23:35:47.049282 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:47.049282 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 23:35:47.049282 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:47.049282 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:35:47.049282 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:35:47.049282 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:35:47.049282 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:35:47.049282 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:35:47.050446 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:35:47.050446 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:35:47.050446 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:35:47.050446 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:35:47.050446 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:35:47.050446 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:35:47.050446 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 23:35:47.050446 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 23:35:47.050446 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 23:35:47.050446 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 23:35:47.050446 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:35:47.050446 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:35:47.050446 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:35:47.050446 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:35:47.050446 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:35:47.050446 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:35:47.051463 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:35:47.051463 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:35:47.051463 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:35:47.051463 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:35:47.051463 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:35:47.051463 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:35:47.051463 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:35:47.051463 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:35:47.051463 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:35:47.051463 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:35:47.051463 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 23:35:47.051463 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 23:35:47.051463 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 13 23:35:47.051463 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:35:47.051463 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 412/818] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 13 23:35:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:35:47.056811 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ecdde1-8022-4484-9101-66256b3aea09 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:47.103713 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:47.152742 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ecdde1-8022-4484-9101-66256b3aea09 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:47.184916 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c94ca-18fb-4f72-9bfc-d286ad930c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:47.185571 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c94ca-18fb-4f72-9bfc-d286ad930c67 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:47.185853 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c94ca-18fb-4f72-9bfc-d286ad930c67 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:47.186123 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c94ca-18fb-4f72-9bfc-d286ad930c67 None admin] PATH_INFO: `/v3/services` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:47.186813 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817c94ca-18fb-4f72-9bfc-d286ad930c67 None admin] RBAC: Adding query filter params (name=compute) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:47.187117 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817c94ca-18fb-4f72-9bfc-d286ad930c67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:47.188463 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817c94ca-18fb-4f72-9bfc-d286ad930c67 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:47.193102 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 407/819] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jul 13 23:35:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:47.199238 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341dbb63-0438-4999-928c-6e0739a39e3f None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:47.298167 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341dbb63-0438-4999-928c-6e0739a39e3f None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:47.332092 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d87cb-249a-4f07-8ae4-d46078f94c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:47.332680 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d87cb-249a-4f07-8ae4-d46078f94c5f None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:47.333000 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d87cb-249a-4f07-8ae4-d46078f94c5f None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:47.333307 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d87cb-249a-4f07-8ae4-d46078f94c5f None admin] PATH_INFO: `/v3/services` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:47.333999 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d87cb-249a-4f07-8ae4-d46078f94c5f None admin] RBAC: Adding query filter params (type=compute) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:35:47.334307 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d87cb-249a-4f07-8ae4-d46078f94c5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:47.335659 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d87cb-249a-4f07-8ae4-d46078f94c5f None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:47.337762 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:47.341185 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 413/820] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jul 13 23:35:47 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:35:47.347006 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c94ca-18fb-4f72-9bfc-d286ad930c67 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:35:47.443927 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c94ca-18fb-4f72-9bfc-d286ad930c67 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:35:47.457315 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:35:47.477640 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3898c8-d99e-40bf-92e9-32ef85f2ad7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:35:47.478428 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3898c8-d99e-40bf-92e9-32ef85f2ad7a None admin] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:35:47.478712 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3898c8-d99e-40bf-92e9-32ef85f2ad7a None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:35:47.478986 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3898c8-d99e-40bf-92e9-32ef85f2ad7a None admin] PATH_INFO: `/v3/endpoints` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:35:47.479726 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3898c8-d99e-40bf-92e9-32ef85f2ad7a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:35:47.481114 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3898c8-d99e-40bf-92e9-32ef85f2ad7a None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:35:47.498506 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 408/821] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 13 23:35:47 2022] POST /identity/v3/endpoints => generated 334 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 23:35:57.494000 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=14,keystone:INSERT=1 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:36:48.124540 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df4076-9688-4b5b-af79-c8d8812353ac None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:36:48.125180 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df4076-9688-4b5b-af79-c8d8812353ac None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:36:48.125180 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df4076-9688-4b5b-af79-c8d8812353ac None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:36:48.126468 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 414/822] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:36:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:36:48.132809 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1a963-51c6-4c8a-8956-a95c2db7580c None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:36:48.133345 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1a963-51c6-4c8a-8956-a95c2db7580c None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:36:48.133432 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1a963-51c6-4c8a-8956-a95c2db7580c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:36:48.152536 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-64f1a963-51c6-4c8a-8956-a95c2db7580c None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:36:48.154035 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-64f1a963-51c6-4c8a-8956-a95c2db7580c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:36:48.249843 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 409/823] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:36:48 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 23:36:48.280028 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df4076-9688-4b5b-af79-c8d8812353ac None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:36:48.410265 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df4076-9688-4b5b-af79-c8d8812353ac None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:36:48.460390 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef3403-c8ae-4b25-98d6-a0a64c0a272e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:36:48.461385 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef3403-c8ae-4b25-98d6-a0a64c0a272e None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:36:48.461832 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef3403-c8ae-4b25-98d6-a0a64c0a272e None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:36:48.462142 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef3403-c8ae-4b25-98d6-a0a64c0a272e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:36:48.477870 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef3403-c8ae-4b25-98d6-a0a64c0a272e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:36:48.479384 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef3403-c8ae-4b25-98d6-a0a64c0a272e None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:36:48.502789 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-c2ef3403-c8ae-4b25-98d6-a0a64c0a272e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:36:48.502789 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:36:48.502789 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:36:48.502789 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:36:48.502789 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:36:48.502789 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:36:48.502789 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:36:48.502789 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:36:48.502789 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:36:48.502789 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:36:48.502789 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:36:48.502789 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:36:48.502789 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:36:48.502789 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:36:48.502789 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:36:48.504016 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:36:48.504016 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:36:48.504016 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:36:48.504016 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:36:48.504016 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:36:48.504016 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:36:48.504016 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:36:48.504016 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:36:48.504016 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:36:48.504016 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:36:48.504016 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:36:48.504016 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:36:48.504016 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:36:48.504016 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:36:48.504016 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:36:48.504016 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:36:48.504016 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:36:48.505019 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:36:48.505019 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:36:48.505019 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:36:48.505019 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:36:48.505019 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 415/824] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:36:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:36:48.510713 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1a963-51c6-4c8a-8956-a95c2db7580c None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:36:48.638918 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1a963-51c6-4c8a-8956-a95c2db7580c None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:36:48.670307 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:36:48.681494 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09743588-5042-4933-ad3c-f2772d4b7e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:36:48.682189 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09743588-5042-4933-ad3c-f2772d4b7e1a None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:36:48.682477 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09743588-5042-4933-ad3c-f2772d4b7e1a None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:36:48.682760 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09743588-5042-4933-ad3c-f2772d4b7e1a None admin] PATH_INFO: `/v3/domains` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:36:48.683482 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09743588-5042-4933-ad3c-f2772d4b7e1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:36:48.683788 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09743588-5042-4933-ad3c-f2772d4b7e1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:36:48.685214 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09743588-5042-4933-ad3c-f2772d4b7e1a None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:36:48.698013 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 410/825] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:36:48.703935 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef3403-c8ae-4b25-98d6-a0a64c0a272e None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:36:48.769477 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:36:48.827291 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef3403-c8ae-4b25-98d6-a0a64c0a272e None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:36:48.867154 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d72451-3ea9-4167-92aa-b3dd1ee5e6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:36:48.867876 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d72451-3ea9-4167-92aa-b3dd1ee5e6e1 None admin] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:36:48.868155 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d72451-3ea9-4167-92aa-b3dd1ee5e6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:36:48.868430 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d72451-3ea9-4167-92aa-b3dd1ee5e6e1 None admin] PATH_INFO: `/v3/users` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:36:48.869169 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d72451-3ea9-4167-92aa-b3dd1ee5e6e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:36:48.870598 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d72451-3ea9-4167-92aa-b3dd1ee5e6e1 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:36:48.891409 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 416/826] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jul 13 23:36:48 2022] POST /identity/v3/users => generated 251 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 23:36:51.232742 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870457ae-95a8-490b-b512-68096b4def57 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:36:51.233370 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870457ae-95a8-490b-b512-68096b4def57 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:36:51.233370 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870457ae-95a8-490b-b512-68096b4def57 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:36:51.234658 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 411/827] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:36:51.240165 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e31f4-53eb-4fa1-9138-603c1f6542cb None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:36:51.240609 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e31f4-53eb-4fa1-9138-603c1f6542cb None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:36:51.240753 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e31f4-53eb-4fa1-9138-603c1f6542cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:36:51.258560 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-0e6e31f4-53eb-4fa1-9138-603c1f6542cb None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:36:51.259752 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-0e6e31f4-53eb-4fa1-9138-603c1f6542cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:36:51.336283 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 417/828] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:36:51 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 23:36:51.364571 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870457ae-95a8-490b-b512-68096b4def57 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:36:51.484456 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870457ae-95a8-490b-b512-68096b4def57 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:36:51.523865 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7336b738-9fd0-4917-845d-482a3076cfac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:36:51.524760 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336b738-9fd0-4917-845d-482a3076cfac None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:36:51.525123 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336b738-9fd0-4917-845d-482a3076cfac None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:36:51.525450 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336b738-9fd0-4917-845d-482a3076cfac None admin] PATH_INFO: `/v3/roles/service` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:36:51.539035 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7336b738-9fd0-4917-845d-482a3076cfac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:36:51.548614 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-7336b738-9fd0-4917-845d-482a3076cfac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 23:36:51.548614 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:36:51.548614 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:36:51.548614 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:36:51.548614 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:36:51.548614 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:36:51.548614 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:36:51.548614 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:36:51.548614 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:36:51.548614 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:36:51.548614 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:36:51.548614 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:36:51.548614 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:36:51.548614 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:36:51.548614 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:36:51.548614 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:36:51.549930 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:36:51.549930 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:36:51.549930 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:36:51.549930 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:36:51.549930 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:36:51.549930 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:36:51.549930 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:36:51.549930 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:36:51.549930 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:36:51.549930 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:36:51.549930 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:36:51.549930 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:36:51.549930 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:36:51.549930 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:36:51.549930 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:36:51.549930 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:36:51.550985 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:36:51.550985 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:36:51.550985 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:36:51.550985 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:36:51.550985 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:36:51.550985 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:36:51.550985 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:36:51.550985 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:36:51.550985 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:36:51.550985 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:36:51.550985 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 23:36:51.550985 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:36:51.550985 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 412/829] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jul 13 23:36:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 23:36:51.555111 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e31f4-53eb-4fa1-9138-603c1f6542cb None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:36:51.602871 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:36:51.671309 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e31f4-53eb-4fa1-9138-603c1f6542cb None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:36:51.710112 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270cedce-3ca0-4895-ba02-8c555ec0e937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:36:51.710864 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270cedce-3ca0-4895-ba02-8c555ec0e937 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:36:51.711212 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270cedce-3ca0-4895-ba02-8c555ec0e937 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:36:51.711501 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270cedce-3ca0-4895-ba02-8c555ec0e937 None admin] PATH_INFO: `/v3/roles` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:36:51.712310 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270cedce-3ca0-4895-ba02-8c555ec0e937 None admin] RBAC: Adding query filter params (name=service) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:36:51.712713 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270cedce-3ca0-4895-ba02-8c555ec0e937 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:36:51.714278 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270cedce-3ca0-4895-ba02-8c555ec0e937 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:36:51.723632 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 418/830] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jul 13 23:36:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:36:51.730697 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7336b738-9fd0-4917-845d-482a3076cfac None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:36:51.783544 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:36:51.840707 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7336b738-9fd0-4917-845d-482a3076cfac None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:36:51.877000 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86576b8e-fb95-4f00-b4fe-8a17d3cf049a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:36:51.877783 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86576b8e-fb95-4f00-b4fe-8a17d3cf049a None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:36:51.878069 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86576b8e-fb95-4f00-b4fe-8a17d3cf049a None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:36:51.878344 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86576b8e-fb95-4f00-b4fe-8a17d3cf049a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:36:51.889970 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86576b8e-fb95-4f00-b4fe-8a17d3cf049a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:36:51.891416 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86576b8e-fb95-4f00-b4fe-8a17d3cf049a None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:36:51.909252 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-86576b8e-fb95-4f00-b4fe-8a17d3cf049a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:36:51.909252 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:36:51.909252 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:36:51.909252 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:36:51.909252 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:36:51.909252 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:36:51.909252 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:36:51.909252 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:36:51.909252 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:36:51.909252 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:36:51.909252 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:36:51.909252 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:36:51.909252 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:36:51.909252 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:36:51.909252 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:36:51.910368 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:36:51.910368 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:36:51.910368 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:36:51.910368 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:36:51.910368 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:36:51.910368 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:36:51.910368 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:36:51.910368 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:36:51.910368 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:36:51.910368 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:36:51.910368 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:36:51.910368 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:36:51.910368 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:36:51.910368 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:36:51.910368 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:36:51.910368 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:36:51.910368 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:36:51.911465 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:36:51.911465 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:36:51.911465 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:36:51.911465 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:36:51.911465 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 413/831] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:36:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:36:51.917612 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270cedce-3ca0-4895-ba02-8c555ec0e937 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:36:52.030875 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:36:52.034908 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270cedce-3ca0-4895-ba02-8c555ec0e937 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:36:52.071751 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03bd39-6d99-4b3e-b409-f87c5554d5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:36:52.072878 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03bd39-6d99-4b3e-b409-f87c5554d5d4 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:36:52.073341 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03bd39-6d99-4b3e-b409-f87c5554d5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:36:52.073802 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03bd39-6d99-4b3e-b409-f87c5554d5d4 None admin] PATH_INFO: `/v3/domains` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:36:52.075064 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df03bd39-6d99-4b3e-b409-f87c5554d5d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:36:52.075581 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df03bd39-6d99-4b3e-b409-f87c5554d5d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:36:52.078020 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df03bd39-6d99-4b3e-b409-f87c5554d5d4 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:36:52.096508 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 419/832] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:36:52.103885 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86576b8e-fb95-4f00-b4fe-8a17d3cf049a None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:36:52.216981 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:36:52.221655 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86576b8e-fb95-4f00-b4fe-8a17d3cf049a None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:36:52.260441 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828a9c0-9623-4bd3-9355-2c7ccbd3dffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:36:52.261369 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828a9c0-9623-4bd3-9355-2c7ccbd3dffe None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:36:52.261913 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828a9c0-9623-4bd3-9355-2c7ccbd3dffe None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:36:52.262215 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828a9c0-9623-4bd3-9355-2c7ccbd3dffe None admin] PATH_INFO: `/v3/users/placement` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:36:52.270816 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828a9c0-9623-4bd3-9355-2c7ccbd3dffe None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:36:52.273875 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828a9c0-9623-4bd3-9355-2c7ccbd3dffe None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:36:52.290336 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-a828a9c0-9623-4bd3-9355-2c7ccbd3dffe None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 13 23:36:52.290336 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:36:52.290336 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:36:52.290336 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:36:52.290336 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:36:52.290336 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:36:52.290336 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:36:52.290336 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:36:52.290336 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:36:52.290336 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:36:52.290336 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:36:52.290336 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:36:52.290336 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 23:36:52.290336 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 23:36:52.290336 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 23:36:52.290336 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 23:36:52.291350 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:36:52.291350 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:36:52.291350 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 23:36:52.291350 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 23:36:52.291350 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 23:36:52.291350 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 23:36:52.291350 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:36:52.291350 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:36:52.291350 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:36:52.291350 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:36:52.291350 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:36:52.291350 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:36:52.291350 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:36:52.291350 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:36:52.291350 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:36:52.291350 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:36:52.291350 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:36:52.291350 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:36:52.292285 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:36:52.292285 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:36:52.292285 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 23:36:52.292285 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 23:36:52.292285 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 23:36:52.292285 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 23:36:52.292285 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 23:36:52.292285 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 23:36:52.292285 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 13 23:36:52.292285 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:36:52.292285 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 414/833] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:36:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 23:36:52.298122 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03bd39-6d99-4b3e-b409-f87c5554d5d4 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:36:52.404947 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03bd39-6d99-4b3e-b409-f87c5554d5d4 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:36:52.441964 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9d773-3746-46ed-9a4f-9f9b057c71e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:36:52.442635 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9d773-3746-46ed-9a4f-9f9b057c71e1 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:36:52.442915 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9d773-3746-46ed-9a4f-9f9b057c71e1 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:36:52.443188 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9d773-3746-46ed-9a4f-9f9b057c71e1 None admin] PATH_INFO: `/v3/users` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:36:52.444911 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9d773-3746-46ed-9a4f-9f9b057c71e1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:36:52.445223 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9d773-3746-46ed-9a4f-9f9b057c71e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:36:52.446628 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9d773-3746-46ed-9a4f-9f9b057c71e1 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:36:52.464727 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 420/834] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Jul 13 23:36:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:36:52.470380 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828a9c0-9623-4bd3-9355-2c7ccbd3dffe None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:36:52.586638 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828a9c0-9623-4bd3-9355-2c7ccbd3dffe None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:36:52.623649 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd49eda-57a4-4000-a298-6f34e72fc198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:36:52.624369 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd49eda-57a4-4000-a298-6f34e72fc198 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:36:52.624721 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd49eda-57a4-4000-a298-6f34e72fc198 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:36:52.625129 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd49eda-57a4-4000-a298-6f34e72fc198 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:36:52.660493 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:36:52.717231 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd49eda-57a4-4000-a298-6f34e72fc198 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:36:52.718953 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd49eda-57a4-4000-a298-6f34e72fc198 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:36:52.820101 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 415/835] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 13 23:36:52 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 23:36:52.824999 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9d773-3746-46ed-9a4f-9f9b057c71e1 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:36:52.847507 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:36:52.947990 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9d773-3746-46ed-9a4f-9f9b057c71e1 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:36:52.985118 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9f812-86cf-42cb-83bd-65f1edf95618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:36:52.986932 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9f812-86cf-42cb-83bd-65f1edf95618 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:36:52.987220 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9f812-86cf-42cb-83bd-65f1edf95618 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:36:52.987494 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9f812-86cf-42cb-83bd-65f1edf95618 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:36:53.001951 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d9f812-86cf-42cb-83bd-65f1edf95618 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:36:53.003409 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d9f812-86cf-42cb-83bd-65f1edf95618 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:36:53.024310 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-a0d9f812-86cf-42cb-83bd-65f1edf95618 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:36:53.024310 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:36:53.024310 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:36:53.024310 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:36:53.024310 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:36:53.024310 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:36:53.024310 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:36:53.024310 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:36:53.024310 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:36:53.024310 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:36:53.024310 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:36:53.024310 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:36:53.024310 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:36:53.024310 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:36:53.024310 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:36:53.025511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:36:53.025511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:36:53.025511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:36:53.025511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:36:53.025511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:36:53.025511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:36:53.025511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:36:53.025511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:36:53.025511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:36:53.025511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:36:53.025511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:36:53.025511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:36:53.025511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:36:53.025511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:36:53.025511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:36:53.025511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:36:53.025511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:36:53.026430 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:36:53.026430 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:36:53.026430 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:36:53.026430 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:36:53.026430 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 421/836] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:36:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:36:53.031489 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd49eda-57a4-4000-a298-6f34e72fc198 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:36:53.098049 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:36:53.149402 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd49eda-57a4-4000-a298-6f34e72fc198 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:36:53.187499 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282207a-8aa5-49c6-b7d3-e46180ab8fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:36:53.188253 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282207a-8aa5-49c6-b7d3-e46180ab8fc0 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:36:53.188671 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282207a-8aa5-49c6-b7d3-e46180ab8fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:36:53.189098 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282207a-8aa5-49c6-b7d3-e46180ab8fc0 None admin] PATH_INFO: `/v3/domains` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:36:53.190048 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0282207a-8aa5-49c6-b7d3-e46180ab8fc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:36:53.190411 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0282207a-8aa5-49c6-b7d3-e46180ab8fc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:36:53.192028 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0282207a-8aa5-49c6-b7d3-e46180ab8fc0 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:36:53.207929 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 416/837] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:36:53.215471 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9f812-86cf-42cb-83bd-65f1edf95618 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:36:53.286405 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:36:53.321195 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9f812-86cf-42cb-83bd-65f1edf95618 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:36:53.362525 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf14857-92f9-4b21-a255-db5b3b9dcd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:36:53.363358 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf14857-92f9-4b21-a255-db5b3b9dcd2b None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:36:53.363673 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf14857-92f9-4b21-a255-db5b3b9dcd2b None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:36:53.363984 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf14857-92f9-4b21-a255-db5b3b9dcd2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:36:53.371890 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf14857-92f9-4b21-a255-db5b3b9dcd2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:36:53.373477 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf14857-92f9-4b21-a255-db5b3b9dcd2b None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:36:53.388891 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-aaf14857-92f9-4b21-a255-db5b3b9dcd2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 23:36:53.388891 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:36:53.388891 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:36:53.388891 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:36:53.388891 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:36:53.388891 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:36:53.388891 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:36:53.388891 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:36:53.388891 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:36:53.388891 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:36:53.388891 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:36:53.388891 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:36:53.388891 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 23:36:53.388891 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 23:36:53.388891 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 23:36:53.390755 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 23:36:53.390755 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:36:53.390755 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:36:53.390755 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:36:53.390755 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:36:53.390755 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:36:53.390755 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:36:53.390755 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:36:53.390755 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:36:53.390755 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:36:53.390755 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:36:53.390755 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:36:53.390755 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:36:53.390755 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:36:53.390755 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:36:53.390755 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:36:53.390755 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:36:53.391768 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 23:36:53.391768 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 23:36:53.391768 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 23:36:53.391768 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 23:36:53.391768 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 23:36:53.391768 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 23:36:53.391768 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 23:36:53.391768 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:36:53.391768 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 422/838] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 13 23:36:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:36:53.396895 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282207a-8aa5-49c6-b7d3-e46180ab8fc0 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:36:53.509444 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282207a-8aa5-49c6-b7d3-e46180ab8fc0 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:36:53.530138 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:36:53.551522 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385b094-c309-424f-bcfb-924bf111ce3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:36:53.552979 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385b094-c309-424f-bcfb-924bf111ce3d None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:36:53.553268 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385b094-c309-424f-bcfb-924bf111ce3d None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:36:53.553619 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385b094-c309-424f-bcfb-924bf111ce3d None admin] PATH_INFO: `/v3/projects` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:36:53.554408 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6385b094-c309-424f-bcfb-924bf111ce3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:36:53.554710 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6385b094-c309-424f-bcfb-924bf111ce3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:36:53.556142 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6385b094-c309-424f-bcfb-924bf111ce3d None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:36:53.571937 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 417/839] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 13 23:36:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:36:53.576049 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf14857-92f9-4b21-a255-db5b3b9dcd2b None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:36:53.684009 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf14857-92f9-4b21-a255-db5b3b9dcd2b None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:36:53.716399 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:36:53.723147 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3717ac-6cf8-47c3-a752-a456ea3a341f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:36:53.723791 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3717ac-6cf8-47c3-a752-a456ea3a341f None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:36:53.724148 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3717ac-6cf8-47c3-a752-a456ea3a341f None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:36:53.724420 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3717ac-6cf8-47c3-a752-a456ea3a341f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:36:53.725438 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3717ac-6cf8-47c3-a752-a456ea3a341f None admin] RBAC: Adding query filter params (role.id=3f7019b9af764b4089ae3cd30e8e2fb9, scope.project.id=11b8489ad08d40bc8f19a6ffa01c6897, user.id=4fbb147d802e48a082c7d928714f1dd7) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:36:53.725795 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3717ac-6cf8-47c3-a752-a456ea3a341f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:36:53.727268 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3717ac-6cf8-47c3-a752-a456ea3a341f None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:36:53.733002 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 423/840] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 13 23:36:53 2022] GET /identity/v3/role_assignments?user.id=4fbb147d802e48a082c7d928714f1dd7&scope.project.id=11b8489ad08d40bc8f19a6ffa01c6897&role.id=3f7019b9af764b4089ae3cd30e8e2fb9 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:36:56.222458 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccf139-af66-437d-88df-4b4b6498c421 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:36:56.223150 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccf139-af66-437d-88df-4b4b6498c421 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:36:56.223150 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccf139-af66-437d-88df-4b4b6498c421 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:36:56.224343 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 418/841] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:36:56.230144 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cee092-99f4-4374-bf58-c6a84414d96e None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:36:56.230688 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cee092-99f4-4374-bf58-c6a84414d96e None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:36:56.230808 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cee092-99f4-4374-bf58-c6a84414d96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:36:56.247774 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-c5cee092-99f4-4374-bf58-c6a84414d96e None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:36:56.248923 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-c5cee092-99f4-4374-bf58-c6a84414d96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:36:56.323541 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 424/842] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:36:56 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 23:36:56.349832 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ccf139-af66-437d-88df-4b4b6498c421 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:36:56.459234 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ccf139-af66-437d-88df-4b4b6498c421 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:36:56.496298 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa93d5-d5f0-401f-8629-cfa2a75a2886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:36:56.497048 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa93d5-d5f0-401f-8629-cfa2a75a2886 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:36:56.497338 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa93d5-d5f0-401f-8629-cfa2a75a2886 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:36:56.497608 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa93d5-d5f0-401f-8629-cfa2a75a2886 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:36:56.508703 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa93d5-d5f0-401f-8629-cfa2a75a2886 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:36:56.516854 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-f9fa93d5-d5f0-401f-8629-cfa2a75a2886 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 23:36:56.516854 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:36:56.516854 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:36:56.516854 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:36:56.516854 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:36:56.516854 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:36:56.516854 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:36:56.516854 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:36:56.516854 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:36:56.516854 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:36:56.516854 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:36:56.516854 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:36:56.516854 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:36:56.516854 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:36:56.516854 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:36:56.516854 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:36:56.518201 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:36:56.518201 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:36:56.518201 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:36:56.518201 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:36:56.518201 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:36:56.518201 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:36:56.518201 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:36:56.518201 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:36:56.518201 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:36:56.518201 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:36:56.518201 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:36:56.518201 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:36:56.518201 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:36:56.518201 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:36:56.518201 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:36:56.518201 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:36:56.519410 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:36:56.519410 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:36:56.519410 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:36:56.519410 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:36:56.519410 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:36:56.519410 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:36:56.519410 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:36:56.519410 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:36:56.519410 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:36:56.519410 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:36:56.519410 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 23:36:56.519410 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:36:56.519410 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 419/843] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jul 13 23:36:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:36:56.524772 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cee092-99f4-4374-bf58-c6a84414d96e None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:36:56.633530 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cee092-99f4-4374-bf58-c6a84414d96e None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:36:56.659048 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:36:56.670371 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfbb014-d087-4140-bb20-65586e83f1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:36:56.671032 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfbb014-d087-4140-bb20-65586e83f1d3 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:36:56.671312 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfbb014-d087-4140-bb20-65586e83f1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:36:56.671586 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfbb014-d087-4140-bb20-65586e83f1d3 None admin] PATH_INFO: `/v3/roles` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:36:56.672315 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfbb014-d087-4140-bb20-65586e83f1d3 None admin] RBAC: Adding query filter params (name=service) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:36:56.672615 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfbb014-d087-4140-bb20-65586e83f1d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:36:56.674008 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfbb014-d087-4140-bb20-65586e83f1d3 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:36:56.683236 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 425/844] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jul 13 23:36:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:36:56.688966 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa93d5-d5f0-401f-8629-cfa2a75a2886 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:36:56.732214 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:36:56.799674 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa93d5-d5f0-401f-8629-cfa2a75a2886 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:36:56.840978 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef530d49-0cdc-43aa-9623-490c01d243f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:36:56.842139 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef530d49-0cdc-43aa-9623-490c01d243f2 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:36:56.842613 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef530d49-0cdc-43aa-9623-490c01d243f2 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:36:56.842973 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef530d49-0cdc-43aa-9623-490c01d243f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:36:56.858520 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef530d49-0cdc-43aa-9623-490c01d243f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:36:56.860848 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef530d49-0cdc-43aa-9623-490c01d243f2 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:36:56.882916 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-ef530d49-0cdc-43aa-9623-490c01d243f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:36:56.882916 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:36:56.882916 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:36:56.882916 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:36:56.882916 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:36:56.882916 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:36:56.882916 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:36:56.882916 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:36:56.882916 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:36:56.882916 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:36:56.882916 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:36:56.882916 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:36:56.882916 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:36:56.882916 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:36:56.882916 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:36:56.884115 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:36:56.884115 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:36:56.884115 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:36:56.884115 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:36:56.884115 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:36:56.884115 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:36:56.884115 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:36:56.884115 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:36:56.884115 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:36:56.884115 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:36:56.884115 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:36:56.884115 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:36:56.884115 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:36:56.884115 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:36:56.884115 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:36:56.884115 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:36:56.884115 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:36:56.885267 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:36:56.885267 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:36:56.885267 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:36:56.885267 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:36:56.885267 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 420/845] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:36:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:36:56.890377 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfbb014-d087-4140-bb20-65586e83f1d3 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:36:57.001736 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfbb014-d087-4140-bb20-65586e83f1d3 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:36:57.041177 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff1aa7-ac4e-45e5-823f-769066aaac9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:36:57.041842 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff1aa7-ac4e-45e5-823f-769066aaac9c None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:36:57.042129 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff1aa7-ac4e-45e5-823f-769066aaac9c None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:36:57.042406 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff1aa7-ac4e-45e5-823f-769066aaac9c None admin] PATH_INFO: `/v3/domains` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:36:57.043119 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff1aa7-ac4e-45e5-823f-769066aaac9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:36:57.043422 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff1aa7-ac4e-45e5-823f-769066aaac9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:36:57.044775 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff1aa7-ac4e-45e5-823f-769066aaac9c None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:36:57.057528 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 426/846] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:36:57.063037 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef530d49-0cdc-43aa-9623-490c01d243f2 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:36:57.159835 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:36:57.169996 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef530d49-0cdc-43aa-9623-490c01d243f2 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:36:57.212002 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2cd97c-f66b-42ed-a4a8-79308ecfee20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:36:57.213184 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2cd97c-f66b-42ed-a4a8-79308ecfee20 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:36:57.213509 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2cd97c-f66b-42ed-a4a8-79308ecfee20 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:36:57.214044 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2cd97c-f66b-42ed-a4a8-79308ecfee20 None admin] PATH_INFO: `/v3/users/placement` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:36:57.224220 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2cd97c-f66b-42ed-a4a8-79308ecfee20 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:36:57.226399 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2cd97c-f66b-42ed-a4a8-79308ecfee20 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:36:57.244557 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-ac2cd97c-f66b-42ed-a4a8-79308ecfee20 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 13 23:36:57.244557 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:36:57.244557 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:36:57.244557 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:36:57.244557 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:36:57.244557 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:36:57.244557 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:36:57.244557 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:36:57.244557 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:36:57.244557 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:36:57.244557 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:36:57.244557 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:36:57.244557 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 23:36:57.244557 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 23:36:57.244557 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 23:36:57.244557 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 23:36:57.245866 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:36:57.245866 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:36:57.245866 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 23:36:57.245866 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 23:36:57.245866 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 23:36:57.245866 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 23:36:57.245866 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:36:57.245866 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:36:57.245866 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:36:57.245866 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:36:57.245866 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:36:57.245866 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:36:57.245866 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:36:57.245866 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:36:57.245866 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:36:57.245866 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:36:57.245866 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:36:57.245866 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:36:57.246929 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:36:57.246929 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:36:57.246929 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 23:36:57.246929 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 23:36:57.246929 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 23:36:57.246929 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 23:36:57.246929 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 23:36:57.246929 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 23:36:57.246929 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 13 23:36:57.246929 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:36:57.246929 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 421/847] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:36:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:36:57.252424 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff1aa7-ac4e-45e5-823f-769066aaac9c None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:36:57.302509 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:36:57.364634 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff1aa7-ac4e-45e5-823f-769066aaac9c None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:36:57.404120 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52244a35-f379-48b1-9f9d-63e67b99cba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:36:57.405248 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52244a35-f379-48b1-9f9d-63e67b99cba7 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:36:57.405735 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52244a35-f379-48b1-9f9d-63e67b99cba7 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:36:57.406075 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52244a35-f379-48b1-9f9d-63e67b99cba7 None admin] PATH_INFO: `/v3/users` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:36:57.406996 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52244a35-f379-48b1-9f9d-63e67b99cba7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:36:57.407304 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52244a35-f379-48b1-9f9d-63e67b99cba7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:36:57.408913 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52244a35-f379-48b1-9f9d-63e67b99cba7 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:36:57.427739 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 427/848] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Jul 13 23:36:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:36:57.433988 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2cd97c-f66b-42ed-a4a8-79308ecfee20 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:36:57.562112 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2cd97c-f66b-42ed-a4a8-79308ecfee20 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:36:57.606732 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac310c01-39fb-47e9-b09e-20efeb1d6068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:36:57.607881 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac310c01-39fb-47e9-b09e-20efeb1d6068 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:36:57.608343 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac310c01-39fb-47e9-b09e-20efeb1d6068 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:36:57.608639 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac310c01-39fb-47e9-b09e-20efeb1d6068 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:36:57.622197 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac310c01-39fb-47e9-b09e-20efeb1d6068 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:36:57.624145 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac310c01-39fb-47e9-b09e-20efeb1d6068 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:36:57.647131 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-ac310c01-39fb-47e9-b09e-20efeb1d6068 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:36:57.647131 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:36:57.647131 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:36:57.647131 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:36:57.647131 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:36:57.647131 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:36:57.647131 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:36:57.647131 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:36:57.647131 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:36:57.647131 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:36:57.647131 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:36:57.647131 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:36:57.647131 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:36:57.647131 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:36:57.647131 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:36:57.648177 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:36:57.648177 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:36:57.648177 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:36:57.648177 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:36:57.648177 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:36:57.648177 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:36:57.648177 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:36:57.648177 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:36:57.648177 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:36:57.648177 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:36:57.648177 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:36:57.648177 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:36:57.648177 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:36:57.648177 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:36:57.648177 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:36:57.648177 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:36:57.648177 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:36:57.649141 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:36:57.649141 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:36:57.649141 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:36:57.649141 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:36:57.649141 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 422/849] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:36:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:36:57.654439 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52244a35-f379-48b1-9f9d-63e67b99cba7 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:36:57.761884 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52244a35-f379-48b1-9f9d-63e67b99cba7 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:36:57.764232 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:36:57.797594 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66307748-4ffe-4321-aefc-5d29557aab9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:36:57.798262 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66307748-4ffe-4321-aefc-5d29557aab9f None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:36:57.798534 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66307748-4ffe-4321-aefc-5d29557aab9f None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:36:57.798839 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66307748-4ffe-4321-aefc-5d29557aab9f None admin] PATH_INFO: `/v3/domains` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:36:57.799522 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66307748-4ffe-4321-aefc-5d29557aab9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:36:57.799832 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66307748-4ffe-4321-aefc-5d29557aab9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:36:57.801222 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66307748-4ffe-4321-aefc-5d29557aab9f None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:36:57.814553 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 428/850] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:36:57.821176 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac310c01-39fb-47e9-b09e-20efeb1d6068 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:36:57.823812 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:36:57.924314 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac310c01-39fb-47e9-b09e-20efeb1d6068 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:36:57.961717 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34320f58-726e-4942-8777-d93efa3af0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:36:57.963237 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34320f58-726e-4942-8777-d93efa3af0d9 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:36:57.963576 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34320f58-726e-4942-8777-d93efa3af0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:36:57.963837 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34320f58-726e-4942-8777-d93efa3af0d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:36:57.971529 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34320f58-726e-4942-8777-d93efa3af0d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:36:57.973099 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34320f58-726e-4942-8777-d93efa3af0d9 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:36:57.988240 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-34320f58-726e-4942-8777-d93efa3af0d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 23:36:57.988240 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:36:57.988240 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:36:57.988240 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:36:57.988240 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:36:57.988240 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:36:57.988240 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:36:57.988240 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:36:57.988240 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:36:57.988240 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:36:57.988240 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:36:57.988240 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:36:57.988240 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 23:36:57.988240 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 23:36:57.988240 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 23:36:57.989281 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 23:36:57.989281 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:36:57.989281 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:36:57.989281 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:36:57.989281 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:36:57.989281 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:36:57.989281 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:36:57.989281 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:36:57.989281 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:36:57.989281 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:36:57.989281 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:36:57.989281 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:36:57.989281 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:36:57.989281 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:36:57.989281 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:36:57.989281 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:36:57.989281 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:36:57.990259 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 23:36:57.990259 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 23:36:57.990259 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 23:36:57.990259 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 23:36:57.990259 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 23:36:57.990259 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 23:36:57.990259 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 23:36:57.990259 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:36:57.990259 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 423/851] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 13 23:36:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 23:36:57.996478 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66307748-4ffe-4321-aefc-5d29557aab9f None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:36:58.111045 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66307748-4ffe-4321-aefc-5d29557aab9f None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:36:58.148596 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c30da-9789-4a8b-8929-8eeef98072c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:36:58.149284 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c30da-9789-4a8b-8929-8eeef98072c3 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:36:58.149565 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c30da-9789-4a8b-8929-8eeef98072c3 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:36:58.149838 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c30da-9789-4a8b-8929-8eeef98072c3 None admin] PATH_INFO: `/v3/projects` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:36:58.150608 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c30da-9789-4a8b-8929-8eeef98072c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:36:58.150913 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c30da-9789-4a8b-8929-8eeef98072c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:36:58.152339 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c30da-9789-4a8b-8929-8eeef98072c3 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:36:58.165868 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 429/852] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 13 23:36:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:36:58.171868 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34320f58-726e-4942-8777-d93efa3af0d9 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:36:58.245942 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:36:58.286891 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34320f58-726e-4942-8777-d93efa3af0d9 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:36:58.322136 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684feaff-5482-40f3-8606-323b983aab45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:36:58.322338 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684feaff-5482-40f3-8606-323b983aab45 None admin] REQUEST_METHOD: `PUT` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:36:58.322492 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684feaff-5482-40f3-8606-323b983aab45 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:36:58.322777 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684feaff-5482-40f3-8606-323b983aab45 None admin] PATH_INFO: `/v3/projects/11b8489ad08d40bc8f19a6ffa01c6897/users/4fbb147d802e48a082c7d928714f1dd7/roles/3f7019b9af764b4089ae3cd30e8e2fb9` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:36:58.338075 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684feaff-5482-40f3-8606-323b983aab45 None admin] RBAC: Authorizing `identity:create_grant(project_id=11b8489ad08d40bc8f19a6ffa01c6897, user_id=4fbb147d802e48a082c7d928714f1dd7, role_id=3f7019b9af764b4089ae3cd30e8e2fb9)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:36:58.339552 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684feaff-5482-40f3-8606-323b983aab45 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:36:58.352172 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 424/853] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jul 13 23:36:58 2022] PUT /identity/v3/projects/11b8489ad08d40bc8f19a6ffa01c6897/users/4fbb147d802e48a082c7d928714f1dd7/roles/3f7019b9af764b4089ae3cd30e8e2fb9 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 23:37:00.744036 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255748c-316b-4ba9-9d4e-c3a8423cd462 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:00.744659 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255748c-316b-4ba9-9d4e-c3a8423cd462 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:00.744659 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255748c-316b-4ba9-9d4e-c3a8423cd462 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:00.746105 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 430/854] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:37:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:37:00.751955 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be76d9b-8f59-4565-a361-eab4f5eb175b None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:00.752389 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be76d9b-8f59-4565-a361-eab4f5eb175b None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:00.752577 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be76d9b-8f59-4565-a361-eab4f5eb175b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:00.770754 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-5be76d9b-8f59-4565-a361-eab4f5eb175b None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:37:00.771987 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-5be76d9b-8f59-4565-a361-eab4f5eb175b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:37:00.857129 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 425/855] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:37:00 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 23:37:00.891032 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255748c-316b-4ba9-9d4e-c3a8423cd462 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:00.920748 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:37:01.011809 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255748c-316b-4ba9-9d4e-c3a8423cd462 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:01.052581 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc634a-a9a8-46c9-b9e1-fde576448cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:01.054012 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc634a-a9a8-46c9-b9e1-fde576448cbb None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:01.054306 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc634a-a9a8-46c9-b9e1-fde576448cbb None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:01.054582 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc634a-a9a8-46c9-b9e1-fde576448cbb None admin] PATH_INFO: `/v3/roles/service` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:01.067219 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc634a-a9a8-46c9-b9e1-fde576448cbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:37:01.077613 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-04dc634a-a9a8-46c9-b9e1-fde576448cbb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 23:37:01.077613 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:37:01.077613 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:37:01.077613 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:37:01.077613 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:37:01.077613 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:37:01.077613 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:37:01.077613 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:37:01.077613 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:37:01.077613 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:37:01.077613 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:37:01.077613 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:37:01.077613 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:37:01.077613 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:37:01.077613 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:37:01.077613 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:37:01.078899 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:37:01.078899 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:37:01.078899 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:37:01.078899 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:37:01.078899 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:37:01.078899 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:37:01.078899 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:37:01.078899 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:37:01.078899 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:37:01.078899 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:37:01.078899 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:37:01.078899 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:37:01.078899 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:37:01.078899 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:37:01.078899 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:37:01.078899 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:37:01.079853 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:37:01.079853 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:37:01.079853 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:37:01.079853 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:37:01.079853 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:37:01.079853 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:37:01.079853 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:37:01.079853 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:37:01.079853 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:37:01.079853 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:37:01.079853 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 23:37:01.079853 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:37:01.079853 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 431/856] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jul 13 23:37:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:37:01.085781 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be76d9b-8f59-4565-a361-eab4f5eb175b None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:01.135965 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:37:01.201182 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be76d9b-8f59-4565-a361-eab4f5eb175b None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:01.242187 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887596d0-6d64-4d46-85b2-607255c7a27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:01.242979 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887596d0-6d64-4d46-85b2-607255c7a27f None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:01.243287 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887596d0-6d64-4d46-85b2-607255c7a27f None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:01.243626 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887596d0-6d64-4d46-85b2-607255c7a27f None admin] PATH_INFO: `/v3/roles` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:01.244537 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887596d0-6d64-4d46-85b2-607255c7a27f None admin] RBAC: Adding query filter params (name=service) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:37:01.244999 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887596d0-6d64-4d46-85b2-607255c7a27f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:01.246469 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887596d0-6d64-4d46-85b2-607255c7a27f None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:01.255192 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 426/857] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jul 13 23:37:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:37:01.262505 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc634a-a9a8-46c9-b9e1-fde576448cbb None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:01.358131 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:37:01.375326 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc634a-a9a8-46c9-b9e1-fde576448cbb None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:01.410479 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d27d3a-6238-4f1b-a8b6-37736fd20fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:01.411278 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d27d3a-6238-4f1b-a8b6-37736fd20fe8 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:01.411609 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d27d3a-6238-4f1b-a8b6-37736fd20fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:01.411829 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d27d3a-6238-4f1b-a8b6-37736fd20fe8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:01.423512 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d27d3a-6238-4f1b-a8b6-37736fd20fe8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:01.425022 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d27d3a-6238-4f1b-a8b6-37736fd20fe8 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:01.442861 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-a2d27d3a-6238-4f1b-a8b6-37736fd20fe8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:37:01.442861 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:37:01.442861 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:37:01.442861 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:37:01.442861 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:37:01.442861 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:37:01.442861 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:37:01.442861 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:37:01.442861 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:37:01.442861 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:37:01.442861 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:37:01.442861 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:37:01.442861 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:37:01.442861 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:37:01.442861 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:37:01.444550 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:37:01.444550 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:37:01.444550 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:37:01.444550 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:37:01.444550 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:37:01.444550 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:37:01.444550 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:37:01.444550 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:37:01.444550 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:37:01.444550 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:37:01.444550 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:37:01.444550 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:37:01.444550 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:37:01.444550 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:37:01.444550 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:37:01.444550 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:37:01.444550 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:37:01.446085 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:37:01.446085 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:37:01.446085 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:37:01.446085 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:37:01.446085 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 432/858] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:37:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:37:01.450517 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887596d0-6d64-4d46-85b2-607255c7a27f None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:01.567554 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887596d0-6d64-4d46-85b2-607255c7a27f None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:01.571324 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:37:01.605442 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c4447-f1a0-4fe2-9363-e25579098de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:01.606140 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c4447-f1a0-4fe2-9363-e25579098de2 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:01.606426 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c4447-f1a0-4fe2-9363-e25579098de2 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:01.606703 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c4447-f1a0-4fe2-9363-e25579098de2 None admin] PATH_INFO: `/v3/domains` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:01.607448 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c4447-f1a0-4fe2-9363-e25579098de2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:37:01.607758 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c4447-f1a0-4fe2-9363-e25579098de2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:01.609201 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c4447-f1a0-4fe2-9363-e25579098de2 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:01.628224 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 427/859] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:37:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:37:01.629816 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d27d3a-6238-4f1b-a8b6-37736fd20fe8 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:01.743200 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d27d3a-6238-4f1b-a8b6-37736fd20fe8 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:01.779570 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec117f8-07c8-4b1f-9fd3-9735b0f495da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:01.780437 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec117f8-07c8-4b1f-9fd3-9735b0f495da None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:01.780800 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec117f8-07c8-4b1f-9fd3-9735b0f495da None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:01.781116 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec117f8-07c8-4b1f-9fd3-9735b0f495da None admin] PATH_INFO: `/v3/users/placement` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:01.783823 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:37:01.790883 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec117f8-07c8-4b1f-9fd3-9735b0f495da None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:01.792721 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec117f8-07c8-4b1f-9fd3-9735b0f495da None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:01.807316 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-3ec117f8-07c8-4b1f-9fd3-9735b0f495da None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 13 23:37:01.807316 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:37:01.807316 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:37:01.807316 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:37:01.807316 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:37:01.807316 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:37:01.807316 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:37:01.807316 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:37:01.807316 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:37:01.807316 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:37:01.807316 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:37:01.807316 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:37:01.807316 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 23:37:01.807316 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 23:37:01.807316 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 23:37:01.807316 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 23:37:01.808467 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:37:01.808467 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:37:01.808467 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 23:37:01.808467 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 23:37:01.808467 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 23:37:01.808467 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 23:37:01.808467 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:37:01.808467 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:37:01.808467 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:37:01.808467 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:37:01.808467 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:37:01.808467 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:37:01.808467 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:37:01.808467 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:37:01.808467 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:37:01.808467 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:37:01.808467 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:37:01.808467 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:37:01.814357 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:37:01.814357 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:37:01.814357 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 23:37:01.814357 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 23:37:01.814357 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 23:37:01.814357 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 23:37:01.814357 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 23:37:01.814357 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 23:37:01.814357 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 13 23:37:01.814357 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:37:01.814357 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 433/860] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:37:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 23:37:01.815066 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c4447-f1a0-4fe2-9363-e25579098de2 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:01.929360 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c4447-f1a0-4fe2-9363-e25579098de2 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:01.968387 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5da3d-0544-44e6-a851-343554cb4da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:01.969113 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5da3d-0544-44e6-a851-343554cb4da4 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:01.969398 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5da3d-0544-44e6-a851-343554cb4da4 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:01.969675 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5da3d-0544-44e6-a851-343554cb4da4 None admin] PATH_INFO: `/v3/users` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:01.970537 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed5da3d-0544-44e6-a851-343554cb4da4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:37:01.970816 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed5da3d-0544-44e6-a851-343554cb4da4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:01.972257 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed5da3d-0544-44e6-a851-343554cb4da4 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:01.990601 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 428/861] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Jul 13 23:37:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:37:01.997665 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec117f8-07c8-4b1f-9fd3-9735b0f495da None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:02.129867 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec117f8-07c8-4b1f-9fd3-9735b0f495da None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:02.178813 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a99c5-60ff-4da4-b395-e6a74fe01157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:02.179581 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a99c5-60ff-4da4-b395-e6a74fe01157 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:02.179912 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a99c5-60ff-4da4-b395-e6a74fe01157 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:02.180247 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a99c5-60ff-4da4-b395-e6a74fe01157 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:02.265319 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:37:02.275671 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a99c5-60ff-4da4-b395-e6a74fe01157 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:02.277168 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a99c5-60ff-4da4-b395-e6a74fe01157 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:02.385982 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 434/862] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 13 23:37:01 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 23:37:02.392234 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5da3d-0544-44e6-a851-343554cb4da4 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:02.420446 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:37:02.501066 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5da3d-0544-44e6-a851-343554cb4da4 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:02.546021 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7922bd29-fe75-4d36-9ad2-1c4b62808f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:02.546817 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922bd29-fe75-4d36-9ad2-1c4b62808f03 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:02.547101 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922bd29-fe75-4d36-9ad2-1c4b62808f03 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:02.547378 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922bd29-fe75-4d36-9ad2-1c4b62808f03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:02.558540 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7922bd29-fe75-4d36-9ad2-1c4b62808f03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:02.559902 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7922bd29-fe75-4d36-9ad2-1c4b62808f03 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:02.581086 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-7922bd29-fe75-4d36-9ad2-1c4b62808f03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:37:02.581086 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:37:02.581086 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:37:02.581086 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:37:02.581086 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:37:02.581086 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:37:02.581086 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:37:02.581086 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:37:02.581086 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:37:02.581086 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:37:02.581086 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:37:02.581086 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:37:02.581086 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:37:02.581086 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:37:02.581086 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:37:02.582285 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:37:02.582285 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:37:02.582285 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:37:02.582285 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:37:02.582285 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:37:02.582285 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:37:02.582285 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:37:02.582285 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:37:02.582285 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:37:02.582285 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:37:02.582285 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:37:02.582285 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:37:02.582285 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:37:02.582285 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:37:02.582285 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:37:02.582285 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:37:02.582285 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:37:02.583442 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:37:02.583442 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:37:02.583442 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:37:02.583442 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:37:02.589428 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 429/863] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:37:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:37:02.590183 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a99c5-60ff-4da4-b395-e6a74fe01157 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:02.693048 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:37:02.704967 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a99c5-60ff-4da4-b395-e6a74fe01157 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:02.743597 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66757f84-a1fa-4ae2-874c-f8ef4557bdb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:02.744278 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66757f84-a1fa-4ae2-874c-f8ef4557bdb9 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:02.744560 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66757f84-a1fa-4ae2-874c-f8ef4557bdb9 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:02.744857 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66757f84-a1fa-4ae2-874c-f8ef4557bdb9 None admin] PATH_INFO: `/v3/domains` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:02.745588 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66757f84-a1fa-4ae2-874c-f8ef4557bdb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:37:02.745896 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66757f84-a1fa-4ae2-874c-f8ef4557bdb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:02.747321 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66757f84-a1fa-4ae2-874c-f8ef4557bdb9 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:02.760197 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 435/864] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:37:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:37:02.766179 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7922bd29-fe75-4d36-9ad2-1c4b62808f03 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:02.847150 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:37:02.878504 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7922bd29-fe75-4d36-9ad2-1c4b62808f03 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:02.913695 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e6b7b-be39-4077-8983-8dc96a3881a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:02.914475 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e6b7b-be39-4077-8983-8dc96a3881a9 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:02.914762 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e6b7b-be39-4077-8983-8dc96a3881a9 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:02.915111 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e6b7b-be39-4077-8983-8dc96a3881a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:02.922201 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e6b7b-be39-4077-8983-8dc96a3881a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:02.923779 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e6b7b-be39-4077-8983-8dc96a3881a9 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:02.938819 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-ed6e6b7b-be39-4077-8983-8dc96a3881a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 23:37:02.938819 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:37:02.938819 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:37:02.938819 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:37:02.938819 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:37:02.938819 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:37:02.938819 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:37:02.938819 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:37:02.938819 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:37:02.938819 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:37:02.938819 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:37:02.938819 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:37:02.938819 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 23:37:02.938819 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 23:37:02.938819 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 23:37:02.944921 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 23:37:02.944921 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:37:02.944921 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:37:02.944921 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:37:02.944921 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:37:02.944921 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:37:02.944921 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:37:02.944921 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:37:02.944921 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:37:02.944921 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:37:02.944921 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:37:02.944921 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:37:02.944921 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:37:02.944921 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:37:02.944921 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:37:02.944921 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:37:02.944921 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:37:02.946002 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 23:37:02.946002 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 23:37:02.946002 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 23:37:02.946002 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 23:37:02.946002 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 23:37:02.946002 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 23:37:02.946002 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 23:37:02.946002 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:37:02.946002 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 430/865] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 13 23:37:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:37:02.946496 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66757f84-a1fa-4ae2-874c-f8ef4557bdb9 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:03.062926 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66757f84-a1fa-4ae2-874c-f8ef4557bdb9 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:03.099241 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0c1e1-8491-410d-a351-3d6100738522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:03.100679 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0c1e1-8491-410d-a351-3d6100738522 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:03.100978 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0c1e1-8491-410d-a351-3d6100738522 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:03.101455 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0c1e1-8491-410d-a351-3d6100738522 None admin] PATH_INFO: `/v3/projects` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:03.102325 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d0c1e1-8491-410d-a351-3d6100738522 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:37:03.102691 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d0c1e1-8491-410d-a351-3d6100738522 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:03.104172 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d0c1e1-8491-410d-a351-3d6100738522 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:03.118296 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 436/866] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 13 23:37:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:37:03.124697 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e6b7b-be39-4077-8983-8dc96a3881a9 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:03.246445 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e6b7b-be39-4077-8983-8dc96a3881a9 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:03.289077 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4abe080-e70b-46a4-9d31-86f1e17c154a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:03.289705 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4abe080-e70b-46a4-9d31-86f1e17c154a None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:03.290012 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4abe080-e70b-46a4-9d31-86f1e17c154a None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:03.290267 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4abe080-e70b-46a4-9d31-86f1e17c154a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:03.291125 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4abe080-e70b-46a4-9d31-86f1e17c154a None admin] RBAC: Adding query filter params (role.id=3f7019b9af764b4089ae3cd30e8e2fb9, scope.project.id=11b8489ad08d40bc8f19a6ffa01c6897, user.id=4fbb147d802e48a082c7d928714f1dd7) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:37:03.291411 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4abe080-e70b-46a4-9d31-86f1e17c154a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:03.293059 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4abe080-e70b-46a4-9d31-86f1e17c154a None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:03.294732 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:37:03.298955 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 431/867] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 13 23:37:03 2022] GET /identity/v3/role_assignments?user.id=4fbb147d802e48a082c7d928714f1dd7&scope.project.id=11b8489ad08d40bc8f19a6ffa01c6897&role.id=3f7019b9af764b4089ae3cd30e8e2fb9 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:37:05.643388 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c0bac-c47b-43ea-a882-f42aafa169a4 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:05.645816 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c0bac-c47b-43ea-a882-f42aafa169a4 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:05.645816 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c0bac-c47b-43ea-a882-f42aafa169a4 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:05.645816 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 437/868] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:37:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:37:05.651855 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e0509-0ebf-4ca8-93d4-a585fe9a6b23 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:05.652363 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e0509-0ebf-4ca8-93d4-a585fe9a6b23 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:05.652468 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e0509-0ebf-4ca8-93d4-a585fe9a6b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:05.673916 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-709e0509-0ebf-4ca8-93d4-a585fe9a6b23 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:37:05.675277 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-709e0509-0ebf-4ca8-93d4-a585fe9a6b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:37:05.751652 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 432/869] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:37:05 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 23:37:05.780558 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c0bac-c47b-43ea-a882-f42aafa169a4 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:05.801393 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:37:05.899021 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c0bac-c47b-43ea-a882-f42aafa169a4 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:05.938838 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f135215-4a94-44fb-8cb5-45032759baec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:05.939685 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f135215-4a94-44fb-8cb5-45032759baec None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:05.939960 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f135215-4a94-44fb-8cb5-45032759baec None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:05.940262 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f135215-4a94-44fb-8cb5-45032759baec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:05.952213 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f135215-4a94-44fb-8cb5-45032759baec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:37:05.960694 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-0f135215-4a94-44fb-8cb5-45032759baec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 23:37:05.960694 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:37:05.960694 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:37:05.960694 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:37:05.960694 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:37:05.960694 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:37:05.960694 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:37:05.960694 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:37:05.960694 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:37:05.960694 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:37:05.960694 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:37:05.960694 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:37:05.960694 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:37:05.960694 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:37:05.960694 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:37:05.960694 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:37:05.961906 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:37:05.961906 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:37:05.961906 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:37:05.961906 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:37:05.961906 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:37:05.961906 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:37:05.961906 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:37:05.961906 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:37:05.961906 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:37:05.961906 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:37:05.961906 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:37:05.961906 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:37:05.961906 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:37:05.961906 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:37:05.961906 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:37:05.961906 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:37:05.962853 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:37:05.962853 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:37:05.962853 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:37:05.962853 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:37:05.962853 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:37:05.962853 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:37:05.962853 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:37:05.962853 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:37:05.962853 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:37:05.962853 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:37:05.962853 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 23:37:05.962853 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:37:05.962853 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 438/870] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 13 23:37:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:37:05.968000 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e0509-0ebf-4ca8-93d4-a585fe9a6b23 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:06.081799 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e0509-0ebf-4ca8-93d4-a585fe9a6b23 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:06.117900 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:37:06.128953 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3d795-fd8f-4c15-be36-dfeb6ca0bbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:06.129622 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3d795-fd8f-4c15-be36-dfeb6ca0bbcb None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:06.130033 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3d795-fd8f-4c15-be36-dfeb6ca0bbcb None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:06.130313 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3d795-fd8f-4c15-be36-dfeb6ca0bbcb None admin] PATH_INFO: `/v3/roles` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:06.131058 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e3d795-fd8f-4c15-be36-dfeb6ca0bbcb None admin] RBAC: Adding query filter params (name=admin) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:37:06.131407 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e3d795-fd8f-4c15-be36-dfeb6ca0bbcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:06.132780 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e3d795-fd8f-4c15-be36-dfeb6ca0bbcb None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:06.142020 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 433/871] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:37:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:37:06.148283 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f135215-4a94-44fb-8cb5-45032759baec None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:06.234149 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:37:06.260075 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f135215-4a94-44fb-8cb5-45032759baec None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:06.300598 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33765e-9a96-47e2-aa33-fd8991f1ca36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:06.301426 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33765e-9a96-47e2-aa33-fd8991f1ca36 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:06.301710 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33765e-9a96-47e2-aa33-fd8991f1ca36 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:06.301982 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33765e-9a96-47e2-aa33-fd8991f1ca36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:06.314938 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33765e-9a96-47e2-aa33-fd8991f1ca36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:06.316627 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33765e-9a96-47e2-aa33-fd8991f1ca36 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:06.336655 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-1f33765e-9a96-47e2-aa33-fd8991f1ca36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:37:06.336655 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:37:06.336655 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:37:06.336655 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:37:06.336655 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:37:06.336655 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:37:06.336655 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:37:06.336655 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:37:06.336655 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:37:06.336655 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:37:06.336655 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:37:06.336655 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:37:06.336655 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:37:06.336655 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:37:06.336655 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:37:06.337757 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:37:06.337757 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:37:06.337757 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:37:06.337757 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:37:06.337757 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:37:06.337757 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:37:06.337757 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:37:06.337757 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:37:06.337757 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:37:06.337757 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:37:06.337757 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:37:06.337757 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:37:06.337757 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:37:06.337757 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:37:06.337757 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:37:06.337757 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:37:06.337757 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:37:06.338746 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:37:06.338746 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:37:06.338746 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:37:06.338746 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:37:06.338746 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 439/872] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:37:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 23:37:06.343937 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3d795-fd8f-4c15-be36-dfeb6ca0bbcb None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:06.457692 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3d795-fd8f-4c15-be36-dfeb6ca0bbcb None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:06.493965 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671206f-9df1-4cbd-9665-598fb51803d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:06.494654 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671206f-9df1-4cbd-9665-598fb51803d5 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:06.495035 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671206f-9df1-4cbd-9665-598fb51803d5 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:06.495334 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671206f-9df1-4cbd-9665-598fb51803d5 None admin] PATH_INFO: `/v3/domains` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:06.496156 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4671206f-9df1-4cbd-9665-598fb51803d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:37:06.496470 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4671206f-9df1-4cbd-9665-598fb51803d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:06.497953 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4671206f-9df1-4cbd-9665-598fb51803d5 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:06.511050 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 434/873] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:37:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:37:06.516958 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33765e-9a96-47e2-aa33-fd8991f1ca36 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:06.635464 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33765e-9a96-47e2-aa33-fd8991f1ca36 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:06.663439 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:37:06.672538 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515b50a-8c84-4d59-acd5-8f0497a06622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:06.673510 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515b50a-8c84-4d59-acd5-8f0497a06622 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:06.673856 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515b50a-8c84-4d59-acd5-8f0497a06622 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:06.674149 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515b50a-8c84-4d59-acd5-8f0497a06622 None admin] PATH_INFO: `/v3/users/placement` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:06.682170 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b515b50a-8c84-4d59-acd5-8f0497a06622 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:06.683731 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b515b50a-8c84-4d59-acd5-8f0497a06622 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:06.700043 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-b515b50a-8c84-4d59-acd5-8f0497a06622 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 13 23:37:06.700043 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:37:06.700043 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:37:06.700043 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:37:06.700043 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:37:06.700043 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:37:06.700043 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:37:06.700043 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:37:06.700043 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:37:06.700043 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:37:06.700043 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:37:06.700043 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:37:06.700043 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 23:37:06.700043 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 23:37:06.700043 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 23:37:06.700043 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 23:37:06.701280 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:37:06.701280 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:37:06.701280 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 23:37:06.701280 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 23:37:06.701280 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 23:37:06.701280 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 23:37:06.701280 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:37:06.701280 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:37:06.701280 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:37:06.701280 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:37:06.701280 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:37:06.701280 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:37:06.701280 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:37:06.701280 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:37:06.701280 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:37:06.701280 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:37:06.701280 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:37:06.701280 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:37:06.702226 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:37:06.702226 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:37:06.702226 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 23:37:06.702226 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 23:37:06.702226 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 23:37:06.702226 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 23:37:06.702226 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 23:37:06.702226 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 23:37:06.702226 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 13 23:37:06.702226 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:37:06.702226 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 440/874] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:37:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:37:06.707388 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671206f-9df1-4cbd-9665-598fb51803d5 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:06.764231 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:37:06.824461 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671206f-9df1-4cbd-9665-598fb51803d5 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:06.864718 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dab49e-5c73-4d56-b386-abac5be57f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:06.865429 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dab49e-5c73-4d56-b386-abac5be57f39 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:06.865802 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dab49e-5c73-4d56-b386-abac5be57f39 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:06.866562 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dab49e-5c73-4d56-b386-abac5be57f39 None admin] PATH_INFO: `/v3/users` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:06.867418 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dab49e-5c73-4d56-b386-abac5be57f39 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:37:06.867729 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dab49e-5c73-4d56-b386-abac5be57f39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:06.869228 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dab49e-5c73-4d56-b386-abac5be57f39 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:06.893390 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 435/875] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Jul 13 23:37:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:37:06.894311 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515b50a-8c84-4d59-acd5-8f0497a06622 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:07.004063 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515b50a-8c84-4d59-acd5-8f0497a06622 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:07.039697 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4404ea-ae60-4be9-b839-3135bc0a2ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:07.040356 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4404ea-ae60-4be9-b839-3135bc0a2ccb None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:07.040643 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4404ea-ae60-4be9-b839-3135bc0a2ccb None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:07.040954 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4404ea-ae60-4be9-b839-3135bc0a2ccb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:07.102533 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:37:07.116109 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4404ea-ae60-4be9-b839-3135bc0a2ccb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:07.117776 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4404ea-ae60-4be9-b839-3135bc0a2ccb None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:07.227684 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 441/876] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 13 23:37:06 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 23:37:07.235326 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dab49e-5c73-4d56-b386-abac5be57f39 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:07.339887 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dab49e-5c73-4d56-b386-abac5be57f39 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:07.349231 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:37:07.375748 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef4872d-daa7-4090-aeb7-2935ce3cbc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:07.376536 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4872d-daa7-4090-aeb7-2935ce3cbc8d None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:07.376877 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4872d-daa7-4090-aeb7-2935ce3cbc8d None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:07.377109 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4872d-daa7-4090-aeb7-2935ce3cbc8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:07.388959 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef4872d-daa7-4090-aeb7-2935ce3cbc8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:07.390400 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef4872d-daa7-4090-aeb7-2935ce3cbc8d None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:07.407724 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-0ef4872d-daa7-4090-aeb7-2935ce3cbc8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:37:07.407724 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:37:07.407724 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:37:07.407724 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:37:07.407724 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:37:07.407724 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:37:07.407724 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:37:07.407724 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:37:07.407724 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:37:07.407724 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:37:07.407724 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:37:07.407724 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:37:07.407724 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:37:07.407724 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:37:07.407724 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:37:07.408676 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:37:07.408676 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:37:07.408676 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:37:07.408676 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:37:07.408676 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:37:07.408676 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:37:07.408676 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:37:07.408676 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:37:07.408676 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:37:07.408676 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:37:07.408676 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:37:07.408676 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:37:07.408676 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:37:07.408676 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:37:07.408676 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:37:07.408676 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:37:07.408676 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:37:07.409640 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:37:07.409640 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:37:07.409640 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:37:07.409640 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:37:07.409640 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 436/877] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:37:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:37:07.415837 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4404ea-ae60-4be9-b839-3135bc0a2ccb None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:07.505105 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:37:07.517934 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4404ea-ae60-4be9-b839-3135bc0a2ccb None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:07.551367 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f74ca-ef8b-48da-be18-2f7f3dbbd130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:07.552024 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f74ca-ef8b-48da-be18-2f7f3dbbd130 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:07.552307 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f74ca-ef8b-48da-be18-2f7f3dbbd130 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:07.552580 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f74ca-ef8b-48da-be18-2f7f3dbbd130 None admin] PATH_INFO: `/v3/domains` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:07.553339 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f74ca-ef8b-48da-be18-2f7f3dbbd130 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:37:07.553789 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f74ca-ef8b-48da-be18-2f7f3dbbd130 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:07.555140 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f74ca-ef8b-48da-be18-2f7f3dbbd130 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:07.566028 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 442/878] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:37:07.572245 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef4872d-daa7-4090-aeb7-2935ce3cbc8d None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:07.668658 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef4872d-daa7-4090-aeb7-2935ce3cbc8d None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:07.704366 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518c30d-9557-40a8-8174-c57ca52e0a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:07.705192 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518c30d-9557-40a8-8174-c57ca52e0a0a None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:07.705481 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518c30d-9557-40a8-8174-c57ca52e0a0a None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:07.705759 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518c30d-9557-40a8-8174-c57ca52e0a0a None admin] PATH_INFO: `/v3/projects/service` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:07.713435 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3518c30d-9557-40a8-8174-c57ca52e0a0a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:07.714882 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3518c30d-9557-40a8-8174-c57ca52e0a0a None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:07.729640 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-3518c30d-9557-40a8-8174-c57ca52e0a0a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 23:37:07.729640 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:37:07.729640 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:37:07.729640 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:37:07.729640 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:37:07.729640 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:37:07.729640 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:37:07.729640 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:37:07.729640 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:37:07.729640 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:37:07.729640 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:37:07.729640 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:37:07.729640 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 23:37:07.729640 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 23:37:07.729640 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 23:37:07.730685 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 23:37:07.730685 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:37:07.730685 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:37:07.730685 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:37:07.730685 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:37:07.730685 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:37:07.730685 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:37:07.730685 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:37:07.730685 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:37:07.730685 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:37:07.730685 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:37:07.730685 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:37:07.730685 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:37:07.730685 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:37:07.730685 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:37:07.730685 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:37:07.730685 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:37:07.731778 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 23:37:07.731778 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 23:37:07.731778 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 23:37:07.731778 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 23:37:07.731778 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 23:37:07.731778 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 23:37:07.731778 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 23:37:07.731778 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:37:07.731778 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 437/879] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 13 23:37:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:37:07.736633 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f74ca-ef8b-48da-be18-2f7f3dbbd130 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:07.833797 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f74ca-ef8b-48da-be18-2f7f3dbbd130 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:07.866091 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0a8cc-37bc-41b3-a974-e295537627d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:07.866733 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0a8cc-37bc-41b3-a974-e295537627d9 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:07.867015 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0a8cc-37bc-41b3-a974-e295537627d9 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:07.867287 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0a8cc-37bc-41b3-a974-e295537627d9 None admin] PATH_INFO: `/v3/projects` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:07.868049 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0a8cc-37bc-41b3-a974-e295537627d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:37:07.868352 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0a8cc-37bc-41b3-a974-e295537627d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:07.869789 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0a8cc-37bc-41b3-a974-e295537627d9 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:07.881403 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 443/880] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 13 23:37:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:37:07.887460 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518c30d-9557-40a8-8174-c57ca52e0a0a None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:07.908729 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:37:07.985329 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518c30d-9557-40a8-8174-c57ca52e0a0a None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:08.019385 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653762d8-ce8b-411f-9ae5-88bb453ed907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:08.020023 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653762d8-ce8b-411f-9ae5-88bb453ed907 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:08.020309 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653762d8-ce8b-411f-9ae5-88bb453ed907 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:08.020586 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653762d8-ce8b-411f-9ae5-88bb453ed907 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:08.021433 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653762d8-ce8b-411f-9ae5-88bb453ed907 None admin] RBAC: Adding query filter params (role.id=46deff0e06964626a5600c9641454603, scope.project.id=11b8489ad08d40bc8f19a6ffa01c6897, user.id=4fbb147d802e48a082c7d928714f1dd7) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:37:08.022272 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653762d8-ce8b-411f-9ae5-88bb453ed907 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:08.023695 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653762d8-ce8b-411f-9ae5-88bb453ed907 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:08.028959 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 438/881] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 13 23:37:07 2022] GET /identity/v3/role_assignments?user.id=4fbb147d802e48a082c7d928714f1dd7&scope.project.id=11b8489ad08d40bc8f19a6ffa01c6897&role.id=46deff0e06964626a5600c9641454603 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:37:10.268406 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70469efe-3cf8-4849-9865-e7b646ba0d8a None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:10.268981 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70469efe-3cf8-4849-9865-e7b646ba0d8a None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:10.269092 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70469efe-3cf8-4849-9865-e7b646ba0d8a None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:10.271289 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 444/882] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:37:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:37:10.277186 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a56f0-d14c-4ecf-bf7c-f60bf015df9c None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:10.277630 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a56f0-d14c-4ecf-bf7c-f60bf015df9c None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:10.277752 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a56f0-d14c-4ecf-bf7c-f60bf015df9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:10.296329 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-363a56f0-d14c-4ecf-bf7c-f60bf015df9c None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:37:10.297647 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-363a56f0-d14c-4ecf-bf7c-f60bf015df9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:37:10.372101 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 439/883] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:37:10 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 23:37:10.400233 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70469efe-3cf8-4849-9865-e7b646ba0d8a None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:10.411073 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:37:10.500277 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70469efe-3cf8-4849-9865-e7b646ba0d8a None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:10.534062 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f4361-07e4-4eae-985e-854f3fb6f88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:10.534785 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f4361-07e4-4eae-985e-854f3fb6f88c None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:10.535068 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f4361-07e4-4eae-985e-854f3fb6f88c None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:10.535353 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f4361-07e4-4eae-985e-854f3fb6f88c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:10.546062 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f4361-07e4-4eae-985e-854f3fb6f88c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:37:10.554437 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-263f4361-07e4-4eae-985e-854f3fb6f88c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 23:37:10.554437 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:37:10.554437 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:37:10.554437 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:37:10.554437 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:37:10.554437 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:37:10.554437 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:37:10.554437 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:37:10.554437 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:37:10.554437 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:37:10.554437 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:37:10.554437 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:37:10.554437 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:37:10.554437 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:37:10.554437 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:37:10.554437 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:37:10.555551 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:37:10.555551 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:37:10.555551 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:37:10.555551 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:37:10.555551 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:37:10.555551 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:37:10.555551 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:37:10.555551 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:37:10.555551 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:37:10.555551 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:37:10.555551 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:37:10.555551 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:37:10.555551 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:37:10.555551 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:37:10.555551 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:37:10.555551 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:37:10.556641 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:37:10.556641 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:37:10.556641 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:37:10.556641 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:37:10.556641 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:37:10.556641 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:37:10.556641 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:37:10.556641 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:37:10.556641 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:37:10.556641 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:37:10.556641 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 23:37:10.556641 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:37:10.556641 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 445/884] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 13 23:37:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:37:10.561772 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a56f0-d14c-4ecf-bf7c-f60bf015df9c None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:10.577380 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:37:10.659991 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a56f0-d14c-4ecf-bf7c-f60bf015df9c None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:10.692802 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b6542-701d-42ca-a542-4aefd457a63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:10.694077 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b6542-701d-42ca-a542-4aefd457a63f None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:10.694376 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b6542-701d-42ca-a542-4aefd457a63f None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:10.694655 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b6542-701d-42ca-a542-4aefd457a63f None admin] PATH_INFO: `/v3/roles` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:10.695508 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b6542-701d-42ca-a542-4aefd457a63f None admin] RBAC: Adding query filter params (name=admin) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:37:10.695847 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b6542-701d-42ca-a542-4aefd457a63f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:10.697246 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b6542-701d-42ca-a542-4aefd457a63f None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:10.705111 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 440/885] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:37:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:37:10.710794 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f4361-07e4-4eae-985e-854f3fb6f88c None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:10.776293 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:37:10.809529 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f4361-07e4-4eae-985e-854f3fb6f88c None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:10.842092 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb125ea-6959-41d3-88c0-2381a9b35734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:10.842867 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb125ea-6959-41d3-88c0-2381a9b35734 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:10.843153 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb125ea-6959-41d3-88c0-2381a9b35734 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:10.843427 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb125ea-6959-41d3-88c0-2381a9b35734 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:10.853628 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb125ea-6959-41d3-88c0-2381a9b35734 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:10.855061 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb125ea-6959-41d3-88c0-2381a9b35734 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:10.872080 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-3eb125ea-6959-41d3-88c0-2381a9b35734 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:37:10.872080 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:37:10.872080 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:37:10.872080 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:37:10.872080 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:37:10.872080 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:37:10.872080 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:37:10.872080 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:37:10.872080 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:37:10.872080 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:37:10.872080 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:37:10.872080 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:37:10.872080 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:37:10.872080 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:37:10.872080 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:37:10.873133 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:37:10.873133 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:37:10.873133 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:37:10.873133 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:37:10.873133 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:37:10.873133 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:37:10.873133 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:37:10.873133 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:37:10.873133 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:37:10.873133 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:37:10.873133 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:37:10.873133 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:37:10.873133 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:37:10.873133 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:37:10.873133 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:37:10.873133 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:37:10.873133 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:37:10.874223 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:37:10.874223 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:37:10.874223 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:37:10.874223 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:37:10.874223 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 446/886] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:37:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:37:10.879008 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b6542-701d-42ca-a542-4aefd457a63f None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:10.954354 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:37:10.978227 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b6542-701d-42ca-a542-4aefd457a63f None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:11.010024 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca8c76-f589-4c29-9f21-e6a3d4a27be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:11.010668 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca8c76-f589-4c29-9f21-e6a3d4a27be4 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:11.010950 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca8c76-f589-4c29-9f21-e6a3d4a27be4 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:11.011224 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca8c76-f589-4c29-9f21-e6a3d4a27be4 None admin] PATH_INFO: `/v3/domains` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:11.012196 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca8c76-f589-4c29-9f21-e6a3d4a27be4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:37:11.012505 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca8c76-f589-4c29-9f21-e6a3d4a27be4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:11.013901 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca8c76-f589-4c29-9f21-e6a3d4a27be4 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:11.026573 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 441/887] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:37:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:37:11.032182 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb125ea-6959-41d3-88c0-2381a9b35734 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:11.130886 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb125ea-6959-41d3-88c0-2381a9b35734 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:11.150403 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:37:11.165222 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c3f48-34e3-42c0-9416-6aa77b378cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:11.166026 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c3f48-34e3-42c0-9416-6aa77b378cc0 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:11.166340 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c3f48-34e3-42c0-9416-6aa77b378cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:11.166622 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c3f48-34e3-42c0-9416-6aa77b378cc0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:11.173956 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c3f48-34e3-42c0-9416-6aa77b378cc0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:11.175392 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c3f48-34e3-42c0-9416-6aa77b378cc0 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:11.191401 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-f82c3f48-34e3-42c0-9416-6aa77b378cc0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 13 23:37:11.191401 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:37:11.191401 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:37:11.191401 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:37:11.191401 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:37:11.191401 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:37:11.191401 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:37:11.191401 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:37:11.191401 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:37:11.191401 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:37:11.191401 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:37:11.191401 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:37:11.191401 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 23:37:11.191401 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 23:37:11.191401 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 23:37:11.191401 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 23:37:11.192889 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:37:11.192889 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:37:11.192889 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 23:37:11.192889 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 23:37:11.192889 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 23:37:11.192889 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 23:37:11.192889 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:37:11.192889 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:37:11.192889 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:37:11.192889 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:37:11.192889 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:37:11.192889 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:37:11.192889 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:37:11.192889 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:37:11.192889 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:37:11.192889 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:37:11.192889 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:37:11.192889 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:37:11.194255 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:37:11.194255 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:37:11.194255 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 23:37:11.194255 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 23:37:11.194255 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 23:37:11.194255 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 23:37:11.194255 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 23:37:11.194255 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 23:37:11.194255 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 13 23:37:11.194255 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:37:11.194255 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 447/888] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:37:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:37:11.199061 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca8c76-f589-4c29-9f21-e6a3d4a27be4 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:11.303700 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca8c76-f589-4c29-9f21-e6a3d4a27be4 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:11.335907 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac1902-02f4-4b04-b255-b9395b6e3bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:11.336557 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac1902-02f4-4b04-b255-b9395b6e3bf8 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:11.336859 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac1902-02f4-4b04-b255-b9395b6e3bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:11.337138 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac1902-02f4-4b04-b255-b9395b6e3bf8 None admin] PATH_INFO: `/v3/users` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:11.337952 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac1902-02f4-4b04-b255-b9395b6e3bf8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:37:11.338255 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac1902-02f4-4b04-b255-b9395b6e3bf8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:11.339661 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac1902-02f4-4b04-b255-b9395b6e3bf8 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:11.342104 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:37:11.356702 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 442/889] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Jul 13 23:37:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:37:11.362316 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c3f48-34e3-42c0-9416-6aa77b378cc0 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:11.460301 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c3f48-34e3-42c0-9416-6aa77b378cc0 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:11.492669 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b7e33-2277-4859-8fcf-4249d33fa993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:11.493465 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b7e33-2277-4859-8fcf-4249d33fa993 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:11.493748 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b7e33-2277-4859-8fcf-4249d33fa993 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:11.494020 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b7e33-2277-4859-8fcf-4249d33fa993 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:11.504761 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b7e33-2277-4859-8fcf-4249d33fa993 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:11.506319 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b7e33-2277-4859-8fcf-4249d33fa993 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:11.523478 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-bf3b7e33-2277-4859-8fcf-4249d33fa993 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:37:11.523478 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:37:11.523478 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:37:11.523478 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:37:11.523478 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:37:11.523478 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:37:11.523478 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:37:11.523478 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:37:11.523478 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:37:11.523478 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:37:11.523478 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:37:11.523478 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:37:11.523478 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:37:11.523478 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:37:11.523478 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:37:11.524338 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:37:11.524338 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:37:11.524338 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:37:11.524338 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:37:11.524338 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:37:11.524338 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:37:11.524338 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:37:11.524338 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:37:11.524338 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:37:11.524338 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:37:11.524338 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:37:11.524338 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:37:11.524338 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:37:11.524338 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:37:11.524338 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:37:11.524338 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:37:11.524338 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:37:11.525259 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:37:11.525259 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:37:11.525259 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:37:11.525259 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:37:11.525259 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 448/890] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:37:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 23:37:11.530199 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac1902-02f4-4b04-b255-b9395b6e3bf8 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:11.626940 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac1902-02f4-4b04-b255-b9395b6e3bf8 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:11.659876 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7299f05-558e-4547-9d89-948843e8eac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:11.660520 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7299f05-558e-4547-9d89-948843e8eac9 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:11.660807 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7299f05-558e-4547-9d89-948843e8eac9 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:11.661116 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7299f05-558e-4547-9d89-948843e8eac9 None admin] PATH_INFO: `/v3/domains` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:11.661829 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7299f05-558e-4547-9d89-948843e8eac9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:37:11.662143 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7299f05-558e-4547-9d89-948843e8eac9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:11.663611 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7299f05-558e-4547-9d89-948843e8eac9 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:11.674357 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 443/891] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:37:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:37:11.680512 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b7e33-2277-4859-8fcf-4249d33fa993 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:11.711865 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:37:11.778515 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b7e33-2277-4859-8fcf-4249d33fa993 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:11.810466 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79792a06-83ef-473f-831a-85c5ef3a3795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:11.811232 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79792a06-83ef-473f-831a-85c5ef3a3795 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:11.811512 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79792a06-83ef-473f-831a-85c5ef3a3795 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:11.811785 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79792a06-83ef-473f-831a-85c5ef3a3795 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:11.818175 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79792a06-83ef-473f-831a-85c5ef3a3795 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:11.819710 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79792a06-83ef-473f-831a-85c5ef3a3795 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:11.833287 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-79792a06-83ef-473f-831a-85c5ef3a3795 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 23:37:11.833287 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:37:11.833287 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:37:11.833287 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:37:11.833287 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:37:11.833287 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:37:11.833287 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:37:11.833287 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:37:11.833287 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:37:11.833287 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:37:11.833287 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:37:11.833287 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:37:11.833287 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 23:37:11.833287 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 23:37:11.833287 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 23:37:11.834167 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 23:37:11.834167 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:37:11.834167 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:37:11.834167 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:37:11.834167 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:37:11.834167 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:37:11.834167 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:37:11.834167 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:37:11.834167 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:37:11.834167 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:37:11.834167 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:37:11.834167 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:37:11.834167 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:37:11.834167 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:37:11.834167 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:37:11.834167 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:37:11.834167 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:37:11.835313 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 23:37:11.835313 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 23:37:11.835313 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 23:37:11.835313 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 23:37:11.835313 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 23:37:11.835313 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 23:37:11.835313 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 23:37:11.835313 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:37:11.835313 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 449/892] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 13 23:37:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:37:11.840373 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7299f05-558e-4547-9d89-948843e8eac9 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:11.895374 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:37:11.939293 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7299f05-558e-4547-9d89-948843e8eac9 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:11.972423 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fa3072-430b-4dc3-9f0b-8f1f7611cc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:11.973036 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa3072-430b-4dc3-9f0b-8f1f7611cc6d None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:11.973323 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa3072-430b-4dc3-9f0b-8f1f7611cc6d None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:11.973600 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa3072-430b-4dc3-9f0b-8f1f7611cc6d None admin] PATH_INFO: `/v3/projects` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:11.974375 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fa3072-430b-4dc3-9f0b-8f1f7611cc6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:37:11.974735 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fa3072-430b-4dc3-9f0b-8f1f7611cc6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:11.976308 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fa3072-430b-4dc3-9f0b-8f1f7611cc6d None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:11.988136 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 444/893] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 13 23:37:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:37:11.994034 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79792a06-83ef-473f-831a-85c5ef3a3795 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:12.083038 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:37:12.092436 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79792a06-83ef-473f-831a-85c5ef3a3795 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:12.126952 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f74d31-e3ea-4e80-b00f-35542ea09b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:12.127837 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f74d31-e3ea-4e80-b00f-35542ea09b61 None admin] REQUEST_METHOD: `PUT` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:12.128118 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f74d31-e3ea-4e80-b00f-35542ea09b61 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:12.128392 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f74d31-e3ea-4e80-b00f-35542ea09b61 None admin] PATH_INFO: `/v3/projects/11b8489ad08d40bc8f19a6ffa01c6897/users/4fbb147d802e48a082c7d928714f1dd7/roles/46deff0e06964626a5600c9641454603` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:12.130362 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f74d31-e3ea-4e80-b00f-35542ea09b61 None admin] RBAC: Authorizing `identity:create_grant(project_id=11b8489ad08d40bc8f19a6ffa01c6897, user_id=4fbb147d802e48a082c7d928714f1dd7, role_id=46deff0e06964626a5600c9641454603)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:12.131969 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f74d31-e3ea-4e80-b00f-35542ea09b61 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:12.144570 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 450/894] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jul 13 23:37:11 2022] PUT /identity/v3/projects/11b8489ad08d40bc8f19a6ffa01c6897/users/4fbb147d802e48a082c7d928714f1dd7/roles/46deff0e06964626a5600c9641454603 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 23:37:14.349082 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ab091-7e4e-4928-a923-139e4e086cce None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:14.350176 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ab091-7e4e-4928-a923-139e4e086cce None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:14.350176 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ab091-7e4e-4928-a923-139e4e086cce None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:14.351504 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 445/895] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:37:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:37:14.356948 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da989a-e7dc-4688-ae6d-c47ccefe0224 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:14.357316 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da989a-e7dc-4688-ae6d-c47ccefe0224 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:14.357529 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da989a-e7dc-4688-ae6d-c47ccefe0224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:14.374527 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-23da989a-e7dc-4688-ae6d-c47ccefe0224 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:37:14.375710 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-23da989a-e7dc-4688-ae6d-c47ccefe0224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:37:14.441181 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 451/896] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:37:14 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 23:37:14.468754 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ab091-7e4e-4928-a923-139e4e086cce None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:14.569425 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ab091-7e4e-4928-a923-139e4e086cce None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:14.582706 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:37:14.603583 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496dcd7-cef8-4c3e-8fb0-4b115337c8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:14.604309 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496dcd7-cef8-4c3e-8fb0-4b115337c8bc None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:14.604598 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496dcd7-cef8-4c3e-8fb0-4b115337c8bc None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:14.604908 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496dcd7-cef8-4c3e-8fb0-4b115337c8bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:14.614994 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1496dcd7-cef8-4c3e-8fb0-4b115337c8bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 23:37:14.622826 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-1496dcd7-cef8-4c3e-8fb0-4b115337c8bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 23:37:14.622826 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:37:14.622826 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:37:14.622826 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:37:14.622826 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:37:14.622826 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:37:14.622826 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:37:14.622826 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:37:14.622826 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:37:14.622826 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:37:14.622826 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:37:14.622826 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:37:14.622826 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 23:37:14.622826 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 23:37:14.622826 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 23:37:14.622826 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 23:37:14.623725 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 23:37:14.623725 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 23:37:14.623725 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 23:37:14.623725 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 23:37:14.623725 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:37:14.623725 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:37:14.623725 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:37:14.623725 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:37:14.623725 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:37:14.623725 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:37:14.623725 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:37:14.623725 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:37:14.623725 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:37:14.623725 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:37:14.623725 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:37:14.623725 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:37:14.624544 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:37:14.624544 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:37:14.624544 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:37:14.624544 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:37:14.624544 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 23:37:14.624544 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 23:37:14.624544 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 23:37:14.624544 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 23:37:14.624544 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 23:37:14.624544 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 23:37:14.624544 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 23:37:14.624544 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:37:14.624544 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 446/897] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 13 23:37:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:37:14.630046 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da989a-e7dc-4688-ae6d-c47ccefe0224 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:14.708453 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:37:14.727521 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da989a-e7dc-4688-ae6d-c47ccefe0224 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:14.759639 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62508d88-b6fc-457f-9486-eb17d704556d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:14.760284 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62508d88-b6fc-457f-9486-eb17d704556d None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:14.760571 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62508d88-b6fc-457f-9486-eb17d704556d None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:14.760870 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62508d88-b6fc-457f-9486-eb17d704556d None admin] PATH_INFO: `/v3/roles` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:14.761861 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62508d88-b6fc-457f-9486-eb17d704556d None admin] RBAC: Adding query filter params (name=admin) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:37:14.762168 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62508d88-b6fc-457f-9486-eb17d704556d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:14.763517 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62508d88-b6fc-457f-9486-eb17d704556d None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:14.771269 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 452/898] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 13 23:37:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:37:14.778084 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496dcd7-cef8-4c3e-8fb0-4b115337c8bc None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:14.875251 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496dcd7-cef8-4c3e-8fb0-4b115337c8bc None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:14.907525 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5db3e9-8961-4a36-9465-4abe6d459c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:14.908301 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5db3e9-8961-4a36-9465-4abe6d459c7b None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:14.908583 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5db3e9-8961-4a36-9465-4abe6d459c7b None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:14.908881 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5db3e9-8961-4a36-9465-4abe6d459c7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:14.919135 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5db3e9-8961-4a36-9465-4abe6d459c7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:14.920566 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5db3e9-8961-4a36-9465-4abe6d459c7b None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:14.938121 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-4c5db3e9-8961-4a36-9465-4abe6d459c7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:37:14.938121 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:37:14.938121 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:37:14.938121 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:37:14.938121 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:37:14.938121 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:37:14.938121 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:37:14.938121 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:37:14.938121 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:37:14.938121 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:37:14.938121 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:37:14.938121 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:37:14.938121 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:37:14.938121 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:37:14.938121 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:37:14.939158 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:37:14.939158 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:37:14.939158 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:37:14.939158 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:37:14.939158 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:37:14.939158 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:37:14.939158 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:37:14.939158 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:37:14.939158 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:37:14.939158 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:37:14.939158 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:37:14.939158 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:37:14.939158 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:37:14.939158 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:37:14.939158 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:37:14.939158 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:37:14.939158 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:37:14.940240 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:37:14.940240 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:37:14.940240 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:37:14.940240 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:37:14.940240 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 447/899] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:37:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:37:14.946704 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62508d88-b6fc-457f-9486-eb17d704556d None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:15.044832 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62508d88-b6fc-457f-9486-eb17d704556d None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:15.077524 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b82ff1-2284-42f3-bbde-3b8cab29dcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:15.078171 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b82ff1-2284-42f3-bbde-3b8cab29dcb9 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:15.078457 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b82ff1-2284-42f3-bbde-3b8cab29dcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:15.078735 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b82ff1-2284-42f3-bbde-3b8cab29dcb9 None admin] PATH_INFO: `/v3/domains` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:15.079439 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b82ff1-2284-42f3-bbde-3b8cab29dcb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:37:15.079748 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b82ff1-2284-42f3-bbde-3b8cab29dcb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:15.081118 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b82ff1-2284-42f3-bbde-3b8cab29dcb9 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:15.093359 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 453/900] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:37:15.099368 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5db3e9-8961-4a36-9465-4abe6d459c7b None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:15.127299 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:37:15.199676 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5db3e9-8961-4a36-9465-4abe6d459c7b None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:15.235452 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d07f32d-ffef-4017-b17f-41a7d40428c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:15.236254 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07f32d-ffef-4017-b17f-41a7d40428c2 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:15.236538 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07f32d-ffef-4017-b17f-41a7d40428c2 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:15.236814 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07f32d-ffef-4017-b17f-41a7d40428c2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:15.244259 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d07f32d-ffef-4017-b17f-41a7d40428c2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:15.245725 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d07f32d-ffef-4017-b17f-41a7d40428c2 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:15.260195 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-9d07f32d-ffef-4017-b17f-41a7d40428c2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 13 23:37:15.260195 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:37:15.260195 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:37:15.260195 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:37:15.260195 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:37:15.260195 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:37:15.260195 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:37:15.260195 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:37:15.260195 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:37:15.260195 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:37:15.260195 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:37:15.260195 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:37:15.260195 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 23:37:15.260195 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 23:37:15.260195 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 23:37:15.260195 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 23:37:15.261607 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:37:15.261607 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:37:15.261607 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 23:37:15.261607 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 23:37:15.261607 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 23:37:15.261607 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 23:37:15.261607 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:37:15.261607 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:37:15.261607 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:37:15.261607 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:37:15.261607 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:37:15.261607 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:37:15.261607 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:37:15.261607 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:37:15.261607 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:37:15.261607 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:37:15.261607 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:37:15.261607 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:37:15.262963 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:37:15.262963 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:37:15.262963 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 23:37:15.262963 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 23:37:15.262963 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 23:37:15.262963 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 23:37:15.262963 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 23:37:15.262963 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 23:37:15.262963 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 13 23:37:15.262963 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:37:15.262963 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 448/901] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:37:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 23:37:15.267367 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b82ff1-2284-42f3-bbde-3b8cab29dcb9 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:15.271138 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:37:15.365781 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b82ff1-2284-42f3-bbde-3b8cab29dcb9 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:15.398969 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420d4f7-bf6e-40f7-b948-fca6de1d42b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:15.399626 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420d4f7-bf6e-40f7-b948-fca6de1d42b1 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:15.399912 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420d4f7-bf6e-40f7-b948-fca6de1d42b1 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:15.400190 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420d4f7-bf6e-40f7-b948-fca6de1d42b1 None admin] PATH_INFO: `/v3/users` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:15.401041 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7420d4f7-bf6e-40f7-b948-fca6de1d42b1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:37:15.401354 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7420d4f7-bf6e-40f7-b948-fca6de1d42b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:15.402779 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7420d4f7-bf6e-40f7-b948-fca6de1d42b1 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:15.419750 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 454/902] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Jul 13 23:37:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:37:15.425398 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d07f32d-ffef-4017-b17f-41a7d40428c2 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:15.507855 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:37:15.523278 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d07f32d-ffef-4017-b17f-41a7d40428c2 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:15.558874 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506bfb4b-8d72-4a38-9857-229152851625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:15.559521 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bfb4b-8d72-4a38-9857-229152851625 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:15.559807 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bfb4b-8d72-4a38-9857-229152851625 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:15.560086 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bfb4b-8d72-4a38-9857-229152851625 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:15.626901 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506bfb4b-8d72-4a38-9857-229152851625 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:15.628343 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506bfb4b-8d72-4a38-9857-229152851625 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:15.713783 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:37:15.729950 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 449/903] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 13 23:37:15 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 23:37:15.735743 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420d4f7-bf6e-40f7-b948-fca6de1d42b1 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:15.795307 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:37:15.832647 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420d4f7-bf6e-40f7-b948-fca6de1d42b1 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:15.864916 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883438b-cba3-434c-b7c6-015196db7cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:15.866345 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883438b-cba3-434c-b7c6-015196db7cc4 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:15.866627 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883438b-cba3-434c-b7c6-015196db7cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:15.866896 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883438b-cba3-434c-b7c6-015196db7cc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:15.876428 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883438b-cba3-434c-b7c6-015196db7cc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:15.877877 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883438b-cba3-434c-b7c6-015196db7cc4 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:15.894935 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-c883438b-cba3-434c-b7c6-015196db7cc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:37:15.894935 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:37:15.894935 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:37:15.894935 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:37:15.894935 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:37:15.894935 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:37:15.894935 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:37:15.894935 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:37:15.894935 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:37:15.894935 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:37:15.894935 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:37:15.894935 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:37:15.894935 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 23:37:15.894935 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 23:37:15.894935 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 23:37:15.895991 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 23:37:15.895991 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:37:15.895991 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:37:15.895991 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:37:15.895991 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:37:15.895991 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:37:15.895991 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:37:15.895991 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:37:15.895991 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:37:15.895991 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:37:15.895991 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:37:15.895991 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:37:15.895991 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:37:15.895991 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:37:15.895991 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:37:15.895991 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:37:15.895991 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:37:15.897121 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 23:37:15.897121 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 23:37:15.897121 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 23:37:15.897121 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:37:15.897121 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 455/904] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:37:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:37:15.901950 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506bfb4b-8d72-4a38-9857-229152851625 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:15.998055 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506bfb4b-8d72-4a38-9857-229152851625 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:16.032446 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8177d6-cfe4-4027-9cb2-7c31f6f510c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:16.033120 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8177d6-cfe4-4027-9cb2-7c31f6f510c3 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:16.033405 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8177d6-cfe4-4027-9cb2-7c31f6f510c3 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:16.033678 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8177d6-cfe4-4027-9cb2-7c31f6f510c3 None admin] PATH_INFO: `/v3/domains` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:16.034392 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8177d6-cfe4-4027-9cb2-7c31f6f510c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:37:16.034692 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8177d6-cfe4-4027-9cb2-7c31f6f510c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:16.036046 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8177d6-cfe4-4027-9cb2-7c31f6f510c3 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:16.047930 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 450/905] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 13 23:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:37:16.054088 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883438b-cba3-434c-b7c6-015196db7cc4 None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:16.151591 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883438b-cba3-434c-b7c6-015196db7cc4 None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:16.166208 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:37:16.186385 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff2e612-30ab-422d-a6ff-ce49800b191e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:16.187212 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2e612-30ab-422d-a6ff-ce49800b191e None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:16.187534 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2e612-30ab-422d-a6ff-ce49800b191e None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:16.187915 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2e612-30ab-422d-a6ff-ce49800b191e None admin] PATH_INFO: `/v3/projects/service` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:16.196117 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff2e612-30ab-422d-a6ff-ce49800b191e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:16.197600 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff2e612-30ab-422d-a6ff-ce49800b191e None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:16.211969 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application [None req-5ff2e612-30ab-422d-a6ff-ce49800b191e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 23:37:16.211969 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:37:16.211969 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:37:16.211969 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:37:16.211969 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:37:16.211969 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:37:16.211969 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:37:16.211969 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:37:16.211969 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:37:16.211969 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:37:16.211969 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:37:16.211969 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:37:16.211969 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 23:37:16.211969 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 23:37:16.211969 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 23:37:16.213068 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 23:37:16.213068 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:37:16.213068 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:37:16.213068 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:37:16.213068 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:37:16.213068 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:37:16.213068 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:37:16.213068 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:37:16.213068 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application with Lock( Jul 13 23:37:16.213068 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:37:16.213068 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:37:16.213068 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:37:16.213068 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:37:16.213068 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:37:16.213068 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:37:16.213068 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:37:16.213068 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:37:16.214217 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 23:37:16.214217 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 23:37:16.214217 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 23:37:16.214217 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 23:37:16.214217 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 23:37:16.214217 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 23:37:16.214217 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 23:37:16.214217 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: ERROR keystone.server.flask.application Jul 13 23:37:16.214217 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 456/906] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 13 23:37:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:37:16.218978 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8177d6-cfe4-4027-9cb2-7c31f6f510c3 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:16.264676 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:37:16.317643 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8177d6-cfe4-4027-9cb2-7c31f6f510c3 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:16.349856 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe221524-f253-409f-afdf-835c8c1c5110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:16.350503 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe221524-f253-409f-afdf-835c8c1c5110 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:16.350788 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe221524-f253-409f-afdf-835c8c1c5110 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:16.351065 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe221524-f253-409f-afdf-835c8c1c5110 None admin] PATH_INFO: `/v3/projects` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:16.351839 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe221524-f253-409f-afdf-835c8c1c5110 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:37:16.352146 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe221524-f253-409f-afdf-835c8c1c5110 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:16.353599 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe221524-f253-409f-afdf-835c8c1c5110 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:16.365103 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 451/907] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 13 23:37:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:37:16.371080 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff2e612-30ab-422d-a6ff-ce49800b191e None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:16.470201 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff2e612-30ab-422d-a6ff-ce49800b191e None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:16.501973 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ead79b-b032-4edb-9594-41adb59b504a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:16.502608 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ead79b-b032-4edb-9594-41adb59b504a None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:16.502893 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ead79b-b032-4edb-9594-41adb59b504a None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:16.503167 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ead79b-b032-4edb-9594-41adb59b504a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:16.503976 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ead79b-b032-4edb-9594-41adb59b504a None admin] RBAC: Adding query filter params (role.id=46deff0e06964626a5600c9641454603, scope.project.id=11b8489ad08d40bc8f19a6ffa01c6897, user.id=4fbb147d802e48a082c7d928714f1dd7) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:37:16.504286 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ead79b-b032-4edb-9594-41adb59b504a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:16.506246 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ead79b-b032-4edb-9594-41adb59b504a None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:16.512127 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 457/908] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 13 23:37:16 2022] GET /identity/v3/role_assignments?user.id=4fbb147d802e48a082c7d928714f1dd7&scope.project.id=11b8489ad08d40bc8f19a6ffa01c6897&role.id=46deff0e06964626a5600c9641454603 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:37:18.737971 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de497f65-a76a-4d46-830b-d1c036c0c760 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:18.738521 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de497f65-a76a-4d46-830b-d1c036c0c760 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:18.738521 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de497f65-a76a-4d46-830b-d1c036c0c760 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:18.739852 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 452/909] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:37:18.745496 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202258f-2dd9-41c1-b71e-e727e0f9358c None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:18.745887 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202258f-2dd9-41c1-b71e-e727e0f9358c None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:18.746048 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202258f-2dd9-41c1-b71e-e727e0f9358c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:18.762836 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-3202258f-2dd9-41c1-b71e-e727e0f9358c None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:37:18.764006 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-3202258f-2dd9-41c1-b71e-e727e0f9358c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:37:18.792599 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:37:18.829467 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 458/910] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:37:18 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 23:37:18.853055 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de497f65-a76a-4d46-830b-d1c036c0c760 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:18.951720 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de497f65-a76a-4d46-830b-d1c036c0c760 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:18.958790 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:37:18.985826 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2997eb-b093-40cb-ba39-0e5cfe4efaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:18.986610 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2997eb-b093-40cb-ba39-0e5cfe4efaa3 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:18.986893 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2997eb-b093-40cb-ba39-0e5cfe4efaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:18.987169 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2997eb-b093-40cb-ba39-0e5cfe4efaa3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:18.987816 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2997eb-b093-40cb-ba39-0e5cfe4efaa3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:18.989219 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2997eb-b093-40cb-ba39-0e5cfe4efaa3 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:19.001331 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-6f2997eb-b093-40cb-ba39-0e5cfe4efaa3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 13 23:37:19.001331 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:37:19.001331 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 23:37:19.001331 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 23:37:19.001331 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 23:37:19.001331 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 23:37:19.001331 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 23:37:19.001331 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 23:37:19.001331 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 13 23:37:19.001331 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:37:19.001331 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 23:37:19.001331 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:37:19.001331 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:37:19.001331 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:37:19.001331 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:37:19.001331 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:37:19.001331 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:37:19.002517 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:37:19.002517 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:37:19.002517 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:37:19.002517 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:37:19.002517 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:37:19.002517 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:37:19.002517 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 23:37:19.002517 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 23:37:19.002517 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 23:37:19.002517 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 23:37:19.002517 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:37:19.002517 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:37:19.002517 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:37:19.002517 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:37:19.002517 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:37:19.002517 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:37:19.003580 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:37:19.003580 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:37:19.003580 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:37:19.003580 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:37:19.003580 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:37:19.003580 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:37:19.003580 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:37:19.003580 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:37:19.003580 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:37:19.003580 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:37:19.003580 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 23:37:19.003580 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 23:37:19.003580 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 13 23:37:19.003580 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:37:19.003580 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 453/911] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jul 13 23:37:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:37:19.009271 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202258f-2dd9-41c1-b71e-e727e0f9358c None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:19.104336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202258f-2dd9-41c1-b71e-e727e0f9358c None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:19.138133 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a5d91-0ed7-434a-a721-f0f340501bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:19.138779 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a5d91-0ed7-434a-a721-f0f340501bec None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:19.139062 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a5d91-0ed7-434a-a721-f0f340501bec None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:19.139339 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a5d91-0ed7-434a-a721-f0f340501bec None admin] PATH_INFO: `/v3/services` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:19.140030 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a5d91-0ed7-434a-a721-f0f340501bec None admin] RBAC: Adding query filter params (name=placement) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:37:19.140333 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a5d91-0ed7-434a-a721-f0f340501bec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:19.141713 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a5d91-0ed7-434a-a721-f0f340501bec None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:19.147094 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 459/912] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Jul 13 23:37:19 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:37:19.153202 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2997eb-b093-40cb-ba39-0e5cfe4efaa3 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:19.259271 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2997eb-b093-40cb-ba39-0e5cfe4efaa3 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:19.291762 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c808cf-2a0a-4cd9-adcf-c9591f50ae3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:19.292417 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c808cf-2a0a-4cd9-adcf-c9591f50ae3a None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:19.292705 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c808cf-2a0a-4cd9-adcf-c9591f50ae3a None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:19.293014 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c808cf-2a0a-4cd9-adcf-c9591f50ae3a None admin] PATH_INFO: `/v3/services` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:19.293719 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c808cf-2a0a-4cd9-adcf-c9591f50ae3a None admin] RBAC: Adding query filter params (type=placement) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:37:19.294029 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c808cf-2a0a-4cd9-adcf-c9591f50ae3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:19.295398 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c808cf-2a0a-4cd9-adcf-c9591f50ae3a None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:19.299738 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 454/913] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Jul 13 23:37:19 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:37:21.496839 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33173412-07c2-40c2-ae92-ec16ac72133d None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:21.497375 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33173412-07c2-40c2-ae92-ec16ac72133d None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:21.497375 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33173412-07c2-40c2-ae92-ec16ac72133d None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:21.498736 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 460/914] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:37:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:37:21.503924 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477ad83-05c7-457a-ae5d-4c4dda55e353 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:21.504300 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477ad83-05c7-457a-ae5d-4c4dda55e353 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:21.504478 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477ad83-05c7-457a-ae5d-4c4dda55e353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:21.521847 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-2477ad83-05c7-457a-ae5d-4c4dda55e353 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:37:21.523069 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-2477ad83-05c7-457a-ae5d-4c4dda55e353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:37:21.549513 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:37:21.589691 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 455/915] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:37:21 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 23:37:21.613580 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33173412-07c2-40c2-ae92-ec16ac72133d None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:21.644516 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:37:21.713741 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33173412-07c2-40c2-ae92-ec16ac72133d None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:21.748162 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5351104f-a260-45fe-8e1f-402229f01b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:21.748745 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351104f-a260-45fe-8e1f-402229f01b37 None admin] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:21.749054 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351104f-a260-45fe-8e1f-402229f01b37 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:21.749323 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351104f-a260-45fe-8e1f-402229f01b37 None admin] PATH_INFO: `/v3/services` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:21.750040 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5351104f-a260-45fe-8e1f-402229f01b37 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:21.751415 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5351104f-a260-45fe-8e1f-402229f01b37 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:21.764906 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 461/916] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jul 13 23:37:21 2022] POST /identity/v3/services => generated 246 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 23:37:24.056447 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc106d8e-379e-4ed4-b54c-305c3d67a47a None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:24.057019 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc106d8e-379e-4ed4-b54c-305c3d67a47a None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:24.057019 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc106d8e-379e-4ed4-b54c-305c3d67a47a None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:24.058374 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 456/917] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:37:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:37:24.063517 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90290e12-a770-46ce-9bb3-a6418277584c None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:24.063937 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90290e12-a770-46ce-9bb3-a6418277584c None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:24.064071 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90290e12-a770-46ce-9bb3-a6418277584c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:24.080237 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-90290e12-a770-46ce-9bb3-a6418277584c None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:37:24.081435 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-90290e12-a770-46ce-9bb3-a6418277584c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:37:24.152391 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 462/918] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:37:24 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 23:37:24.177914 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc106d8e-379e-4ed4-b54c-305c3d67a47a None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:24.277114 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc106d8e-379e-4ed4-b54c-305c3d67a47a None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:24.309876 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6bb80-2a5d-4e2c-80f3-2d859f36e63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:24.310592 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6bb80-2a5d-4e2c-80f3-2d859f36e63e None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:24.310876 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6bb80-2a5d-4e2c-80f3-2d859f36e63e None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:24.311152 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6bb80-2a5d-4e2c-80f3-2d859f36e63e None admin] PATH_INFO: `/v3/services/placement` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:24.311796 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a6bb80-2a5d-4e2c-80f3-2d859f36e63e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:24.313182 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a6bb80-2a5d-4e2c-80f3-2d859f36e63e None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:24.325292 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-18a6bb80-2a5d-4e2c-80f3-2d859f36e63e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 13 23:37:24.325292 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:37:24.325292 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 23:37:24.325292 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 23:37:24.325292 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 23:37:24.325292 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 23:37:24.325292 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 23:37:24.325292 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 23:37:24.325292 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 13 23:37:24.325292 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:37:24.325292 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 23:37:24.325292 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:37:24.325292 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:37:24.325292 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:37:24.325292 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:37:24.325292 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:37:24.325292 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:37:24.326434 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:37:24.326434 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:37:24.326434 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:37:24.326434 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:37:24.326434 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:37:24.326434 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:37:24.326434 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 23:37:24.326434 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 23:37:24.326434 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 23:37:24.326434 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 23:37:24.326434 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:37:24.326434 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:37:24.326434 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:37:24.326434 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:37:24.326434 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:37:24.326434 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:37:24.327257 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:37:24.327257 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:37:24.327257 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:37:24.327257 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:37:24.327257 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:37:24.327257 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:37:24.327257 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:37:24.327257 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:37:24.327257 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:37:24.327257 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:37:24.327257 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 23:37:24.327257 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 23:37:24.327257 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 13 23:37:24.327257 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:37:24.327257 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 457/919] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jul 13 23:37:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 23:37:24.332408 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90290e12-a770-46ce-9bb3-a6418277584c None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:24.350153 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:37:24.428652 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90290e12-a770-46ce-9bb3-a6418277584c None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:24.461608 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79fbee6-ecb3-4909-aa72-b21c9566e6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:24.462261 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fbee6-ecb3-4909-aa72-b21c9566e6bd None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:24.462538 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fbee6-ecb3-4909-aa72-b21c9566e6bd None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:24.462808 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fbee6-ecb3-4909-aa72-b21c9566e6bd None admin] PATH_INFO: `/v3/services` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:24.463492 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79fbee6-ecb3-4909-aa72-b21c9566e6bd None admin] RBAC: Adding query filter params (name=placement) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:37:24.463791 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79fbee6-ecb3-4909-aa72-b21c9566e6bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:24.465171 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79fbee6-ecb3-4909-aa72-b21c9566e6bd None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:24.470089 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 463/920] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Jul 13 23:37:24 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:37:24.476754 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6bb80-2a5d-4e2c-80f3-2d859f36e63e None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:24.505200 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:37:24.577278 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6bb80-2a5d-4e2c-80f3-2d859f36e63e None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:24.609558 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5514ab-cafb-4c4d-8d2a-9699698fe7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:24.610202 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5514ab-cafb-4c4d-8d2a-9699698fe7b5 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:24.610487 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5514ab-cafb-4c4d-8d2a-9699698fe7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:24.610767 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5514ab-cafb-4c4d-8d2a-9699698fe7b5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:24.611552 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5514ab-cafb-4c4d-8d2a-9699698fe7b5 None admin] RBAC: Adding query filter params (interface=public, service_id=ef57d91f17f24264a1619b31601b72a9, region_id=RegionOne) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:37:24.611870 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5514ab-cafb-4c4d-8d2a-9699698fe7b5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:24.613265 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5514ab-cafb-4c4d-8d2a-9699698fe7b5 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:24.618164 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 458/921] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Jul 13 23:37:24 2022] GET /identity/v3/endpoints?service_id=ef57d91f17f24264a1619b31601b72a9&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:37:24.623812 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79fbee6-ecb3-4909-aa72-b21c9566e6bd None admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:24.701938 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:37:24.720043 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79fbee6-ecb3-4909-aa72-b21c9566e6bd None admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:24.751868 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd27f085-9828-48ba-8889-3874338fba72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:24.752511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27f085-9828-48ba-8889-3874338fba72 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:24.752790 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27f085-9828-48ba-8889-3874338fba72 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:24.753093 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27f085-9828-48ba-8889-3874338fba72 None admin] PATH_INFO: `/v3/services` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:24.753755 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd27f085-9828-48ba-8889-3874338fba72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:24.755184 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd27f085-9828-48ba-8889-3874338fba72 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:24.762250 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 464/922] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jul 13 23:37:24 2022] GET /identity/v3/services => generated 1962 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 23:37:26.955266 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edece04e-b051-472b-a8a9-b69bee558b58 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:26.955823 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edece04e-b051-472b-a8a9-b69bee558b58 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:26.955823 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edece04e-b051-472b-a8a9-b69bee558b58 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:26.957227 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 459/923] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:37:26.962289 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85e6e7-1cfd-4201-bb11-53fae87fc98b None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:26.962659 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85e6e7-1cfd-4201-bb11-53fae87fc98b None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:26.962839 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85e6e7-1cfd-4201-bb11-53fae87fc98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:26.979587 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-0a85e6e7-1cfd-4201-bb11-53fae87fc98b None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:37:26.980750 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-0a85e6e7-1cfd-4201-bb11-53fae87fc98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:37:27.046825 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 465/924] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:37:26 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 23:37:27.070904 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edece04e-b051-472b-a8a9-b69bee558b58 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:27.161301 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:37:27.171625 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edece04e-b051-472b-a8a9-b69bee558b58 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:27.206933 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e80f1-5d30-4d62-90ab-63b61bc764c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:27.207655 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e80f1-5d30-4d62-90ab-63b61bc764c2 None admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:27.207939 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e80f1-5d30-4d62-90ab-63b61bc764c2 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:27.208214 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e80f1-5d30-4d62-90ab-63b61bc764c2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:27.209725 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18e80f1-5d30-4d62-90ab-63b61bc764c2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:27.211096 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18e80f1-5d30-4d62-90ab-63b61bc764c2 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:27.222986 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application [None req-a18e80f1-5d30-4d62-90ab-63b61bc764c2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 13 23:37:27.222986 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:37:27.222986 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 23:37:27.222986 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 23:37:27.222986 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 23:37:27.222986 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 23:37:27.222986 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 23:37:27.222986 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 23:37:27.222986 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 13 23:37:27.222986 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:37:27.222986 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 23:37:27.222986 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:37:27.222986 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 23:37:27.222986 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 23:37:27.222986 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 23:37:27.222986 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 23:37:27.222986 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 23:37:27.224728 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 23:37:27.224728 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 23:37:27.224728 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 23:37:27.224728 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 23:37:27.224728 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 23:37:27.224728 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 23:37:27.224728 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 23:37:27.224728 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 23:37:27.224728 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 23:37:27.224728 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 23:37:27.224728 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 23:37:27.224728 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 23:37:27.224728 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 23:37:27.224728 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 23:37:27.224728 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 23:37:27.224728 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 23:37:27.225607 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 23:37:27.225607 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application with Lock( Jul 13 23:37:27.225607 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 23:37:27.225607 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self._enter() Jul 13 23:37:27.225607 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 23:37:27.225607 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 23:37:27.225607 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 23:37:27.225607 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application return self.creator() Jul 13 23:37:27.225607 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 23:37:27.225607 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application created_value = creator( Jul 13 23:37:27.225607 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 23:37:27.225607 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 23:37:27.225607 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 13 23:37:27.225607 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: ERROR keystone.server.flask.application Jul 13 23:37:27.225607 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 460/925] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jul 13 23:37:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 23:37:27.230662 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85e6e7-1cfd-4201-bb11-53fae87fc98b None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:27.305460 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:37:27.328131 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85e6e7-1cfd-4201-bb11-53fae87fc98b None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:27.361182 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b16df77-d67e-4d17-ace9-dfda4e6ae588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:27.361830 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16df77-d67e-4d17-ace9-dfda4e6ae588 None admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:27.362143 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16df77-d67e-4d17-ace9-dfda4e6ae588 None admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:27.362421 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16df77-d67e-4d17-ace9-dfda4e6ae588 None admin] PATH_INFO: `/v3/services` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:27.363115 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b16df77-d67e-4d17-ace9-dfda4e6ae588 None admin] RBAC: Adding query filter params (name=placement) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:37:27.363417 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b16df77-d67e-4d17-ace9-dfda4e6ae588 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:27.364803 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b16df77-d67e-4d17-ace9-dfda4e6ae588 None admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:27.369749 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 466/926] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Jul 13 23:37:27 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 23:37:27.375540 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e80f1-5d30-4d62-90ab-63b61bc764c2 None admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:37:27.472292 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e80f1-5d30-4d62-90ab-63b61bc764c2 None admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:37:27.504803 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2257e31-11a9-4f3a-98cb-be2b47f0f301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:37:27.506197 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2257e31-11a9-4f3a-98cb-be2b47f0f301 None admin] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:37:27.506684 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2257e31-11a9-4f3a-98cb-be2b47f0f301 None admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:37:27.506975 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2257e31-11a9-4f3a-98cb-be2b47f0f301 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:37:27.507721 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2257e31-11a9-4f3a-98cb-be2b47f0f301 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:37:27.509116 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2257e31-11a9-4f3a-98cb-be2b47f0f301 None admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:37:27.528525 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 461/927] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 13 23:37:27 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 23:37:37.366846 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=30 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:37:37.524570 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:38:26.199423 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d351369-3e9c-4380-ad53-6d415c326cd5 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:38:26.199960 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d351369-3e9c-4380-ad53-6d415c326cd5 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:38:26.199960 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d351369-3e9c-4380-ad53-6d415c326cd5 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:38:26.204069 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 467/928] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:38:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:38:26.206583 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9e367-c3f3-4a0d-b8b8-51f8d26b364a None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:38:26.207022 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9e367-c3f3-4a0d-b8b8-51f8d26b364a None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:38:26.207175 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9e367-c3f3-4a0d-b8b8-51f8d26b364a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:38:26.231530 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-0cf9e367-c3f3-4a0d-b8b8-51f8d26b364a None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:38:26.236666 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-0cf9e367-c3f3-4a0d-b8b8-51f8d26b364a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:38:26.352874 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 462/929] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:38:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:38:26.400349 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eab680-8602-45d5-9823-0f04068af643 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:38:26.400640 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eab680-8602-45d5-9823-0f04068af643 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:38:26.400978 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eab680-8602-45d5-9823-0f04068af643 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:38:26.402494 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 468/930] 10.222.0.16 () {54 vars in 964 bytes} [Wed Jul 13 23:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:38:26.429252 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bdd34-81cd-460b-8b81-61017b347368 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:38:26.429527 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bdd34-81cd-460b-8b81-61017b347368 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:38:26.429809 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bdd34-81cd-460b-8b81-61017b347368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:38:26.507131 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-792bdd34-81cd-460b-8b81-61017b347368 None None] MFA Rules not processed for user `05f1ce71ea7c4301ae0bfc84a06c9c38`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:38:26.508458 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-792bdd34-81cd-460b-8b81-61017b347368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:38:26.581010 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 463/931] 10.222.0.16 () {58 vars in 1061 bytes} [Wed Jul 13 23:38:26 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:38:26.584759 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eab680-8602-45d5-9823-0f04068af643 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:38:26.596309 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eab680-8602-45d5-9823-0f04068af643 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:38:26.600971 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f0d35a-313e-408e-a5de-2c0869b6fbd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05f1ce71ea7c4301ae0bfc84a06c9c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:38:26.601329 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0d35a-313e-408e-a5de-2c0869b6fbd9 service neutron] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:38:26.601329 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0d35a-313e-408e-a5de-2c0869b6fbd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:38:26.601927 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0d35a-313e-408e-a5de-2c0869b6fbd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:38:26.611173 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f0d35a-313e-408e-a5de-2c0869b6fbd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:38:26.612685 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f0d35a-313e-408e-a5de-2c0869b6fbd9 service neutron] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:38:26.625349 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 469/932] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:38:26 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 23:38:29.122409 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d9431-ae65-4bc9-b1db-65f617301a57 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:38:29.122944 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d9431-ae65-4bc9-b1db-65f617301a57 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:38:29.123027 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d9431-ae65-4bc9-b1db-65f617301a57 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:38:29.124330 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 464/933] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:38:29.130049 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ae046-f2ad-459d-9257-7b910111bbae None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:38:29.130478 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ae046-f2ad-459d-9257-7b910111bbae None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:38:29.130671 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ae046-f2ad-459d-9257-7b910111bbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:38:29.149261 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-6f0ae046-f2ad-459d-9257-7b910111bbae None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:38:29.150451 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-6f0ae046-f2ad-459d-9257-7b910111bbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:38:29.158063 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 470/934] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:38:29 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:38:29.214238 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c978c-5f9e-4473-8875-ad3c380e430c None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:38:29.214526 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c978c-5f9e-4473-8875-ad3c380e430c None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:38:29.214805 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c978c-5f9e-4473-8875-ad3c380e430c None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:38:29.216162 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 465/935] 10.222.0.16 () {54 vars in 964 bytes} [Wed Jul 13 23:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:38:29.222383 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc9151-56a2-41e6-afa7-2f9b21ac1d9f None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:38:29.222750 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc9151-56a2-41e6-afa7-2f9b21ac1d9f None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:38:29.223101 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc9151-56a2-41e6-afa7-2f9b21ac1d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:38:29.241182 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-1bbc9151-56a2-41e6-afa7-2f9b21ac1d9f None None] MFA Rules not processed for user `05f1ce71ea7c4301ae0bfc84a06c9c38`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:38:29.242371 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-1bbc9151-56a2-41e6-afa7-2f9b21ac1d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:38:29.248801 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 471/936] 10.222.0.16 () {58 vars in 1061 bytes} [Wed Jul 13 23:38:29 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:38:29.258363 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c978c-5f9e-4473-8875-ad3c380e430c None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:38:29.269493 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c978c-5f9e-4473-8875-ad3c380e430c None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:38:29.273889 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50e987-e0d1-439f-950b-c08b8bc4b15f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05f1ce71ea7c4301ae0bfc84a06c9c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:38:29.274560 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50e987-e0d1-439f-950b-c08b8bc4b15f service neutron] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:38:29.274847 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50e987-e0d1-439f-950b-c08b8bc4b15f service neutron] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:38:29.275126 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50e987-e0d1-439f-950b-c08b8bc4b15f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:38:29.284700 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e50e987-e0d1-439f-950b-c08b8bc4b15f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:38:29.286180 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e50e987-e0d1-439f-950b-c08b8bc4b15f service neutron] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:38:29.295841 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 466/937] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:38:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:38:32.141413 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba93837-0eef-4e0f-a0c9-5533e353aec2 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:38:32.141957 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba93837-0eef-4e0f-a0c9-5533e353aec2 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:38:32.141957 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba93837-0eef-4e0f-a0c9-5533e353aec2 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:38:32.143502 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 472/938] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:38:32.149768 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e3c36-2e83-4c4e-81e7-10fa095de9c9 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:38:32.150216 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e3c36-2e83-4c4e-81e7-10fa095de9c9 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:38:32.150322 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e3c36-2e83-4c4e-81e7-10fa095de9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:38:32.187365 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-cb8e3c36-2e83-4c4e-81e7-10fa095de9c9 None None] MFA Rules not processed for user `1db35c40e944463587194d432aaf15bb`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:38:32.188774 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-cb8e3c36-2e83-4c4e-81e7-10fa095de9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:38:32.232864 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:38:32.262576 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 467/939] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:38:32 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:38:32.303580 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba93837-0eef-4e0f-a0c9-5533e353aec2 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:38:32.314086 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba93837-0eef-4e0f-a0c9-5533e353aec2 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:38:32.318045 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c2195-c5e6-4418-a8ca-8781714304db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05f1ce71ea7c4301ae0bfc84a06c9c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:38:32.318664 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c2195-c5e6-4418-a8ca-8781714304db service neutron] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:38:32.318944 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c2195-c5e6-4418-a8ca-8781714304db service neutron] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:38:32.319219 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c2195-c5e6-4418-a8ca-8781714304db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:38:32.328525 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c2195-c5e6-4418-a8ca-8781714304db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:38:32.329979 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c2195-c5e6-4418-a8ca-8781714304db service neutron] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:38:32.340167 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 473/940] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:38:32 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:38:35.303572 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a87d8-bf10-49b7-92c1-4b598c247dfc None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:38:35.304140 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a87d8-bf10-49b7-92c1-4b598c247dfc None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:38:35.304140 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a87d8-bf10-49b7-92c1-4b598c247dfc None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:38:35.305528 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 468/941] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:38:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 23:38:35.310517 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923461c0-c667-47b2-adf1-439729d905cc None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:38:35.311231 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923461c0-c667-47b2-adf1-439729d905cc None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:38:35.311513 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923461c0-c667-47b2-adf1-439729d905cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:38:35.329560 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-923461c0-c667-47b2-adf1-439729d905cc None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:38:35.330728 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-923461c0-c667-47b2-adf1-439729d905cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:38:35.403523 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 474/942] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:38:35 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:38:35.441998 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a87d8-bf10-49b7-92c1-4b598c247dfc None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:38:35.452872 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a87d8-bf10-49b7-92c1-4b598c247dfc None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:38:35.456280 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a3be05-2812-4e3b-945a-3c3f1d2fdbaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05f1ce71ea7c4301ae0bfc84a06c9c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:38:35.456941 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3be05-2812-4e3b-945a-3c3f1d2fdbaa service neutron] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:38:35.457224 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3be05-2812-4e3b-945a-3c3f1d2fdbaa service neutron] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:38:35.457500 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3be05-2812-4e3b-945a-3c3f1d2fdbaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:38:35.466078 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a3be05-2812-4e3b-945a-3c3f1d2fdbaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:38:35.467510 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a3be05-2812-4e3b-945a-3c3f1d2fdbaa service neutron] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:38:35.476982 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 469/943] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:38:35 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:38:38.438792 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273114e-1285-4c2f-a527-9c5c52297b35 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:38:38.439403 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273114e-1285-4c2f-a527-9c5c52297b35 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:38:38.439403 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273114e-1285-4c2f-a527-9c5c52297b35 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:38:38.440721 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 475/944] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:38:38.446134 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebd3f5-dbc4-4ae4-b3e5-24d1159a7b4c None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:38:38.446546 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebd3f5-dbc4-4ae4-b3e5-24d1159a7b4c None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:38:38.446696 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebd3f5-dbc4-4ae4-b3e5-24d1159a7b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:38:38.464646 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-d7ebd3f5-dbc4-4ae4-b3e5-24d1159a7b4c None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:38:38.465855 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-d7ebd3f5-dbc4-4ae4-b3e5-24d1159a7b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:38:38.474310 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 470/945] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:38:38 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:38:38.510154 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273114e-1285-4c2f-a527-9c5c52297b35 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:38:38.524682 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273114e-1285-4c2f-a527-9c5c52297b35 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:38:38.528242 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a721383-c862-412d-8b3a-8f420641f680 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05f1ce71ea7c4301ae0bfc84a06c9c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:38:38.528913 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a721383-c862-412d-8b3a-8f420641f680 service neutron] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:38:38.529201 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a721383-c862-412d-8b3a-8f420641f680 service neutron] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:38:38.529505 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a721383-c862-412d-8b3a-8f420641f680 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:38:38.539454 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a721383-c862-412d-8b3a-8f420641f680 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:38:38.541069 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a721383-c862-412d-8b3a-8f420641f680 service neutron] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:38:38.550719 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 476/946] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:38:38 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:38:40.811286 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84045fb8-9a3d-4b39-9625-d14fa22ade8e None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:38:40.811817 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84045fb8-9a3d-4b39-9625-d14fa22ade8e None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:38:40.811817 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84045fb8-9a3d-4b39-9625-d14fa22ade8e None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:38:40.813149 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 471/947] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:38:40.819062 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afabe1-f26d-4964-a73e-432199b2aad9 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:38:40.819477 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afabe1-f26d-4964-a73e-432199b2aad9 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:38:40.819760 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afabe1-f26d-4964-a73e-432199b2aad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:38:40.837386 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-e2afabe1-f26d-4964-a73e-432199b2aad9 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:38:40.838576 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-e2afabe1-f26d-4964-a73e-432199b2aad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:38:40.846409 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 477/948] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:38:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 23:38:40.883796 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84045fb8-9a3d-4b39-9625-d14fa22ade8e None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:38:40.894709 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84045fb8-9a3d-4b39-9625-d14fa22ade8e None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:38:40.898826 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9c0fd-beb9-4682-b93a-5d0ee51d8ce6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05f1ce71ea7c4301ae0bfc84a06c9c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:38:40.899464 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9c0fd-beb9-4682-b93a-5d0ee51d8ce6 service neutron] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:38:40.899749 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9c0fd-beb9-4682-b93a-5d0ee51d8ce6 service neutron] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:38:40.900024 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9c0fd-beb9-4682-b93a-5d0ee51d8ce6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:38:40.908988 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d9c0fd-beb9-4682-b93a-5d0ee51d8ce6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:38:40.910411 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d9c0fd-beb9-4682-b93a-5d0ee51d8ce6 service neutron] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:38:40.920691 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 472/949] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:38:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:38:43.208046 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06828d96-5129-4777-8d05-cc0848872409 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:38:43.208746 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06828d96-5129-4777-8d05-cc0848872409 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:38:43.209019 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06828d96-5129-4777-8d05-cc0848872409 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:38:43.210410 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 478/950] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:38:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:38:43.216030 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4a8f0-b3d4-467e-b54b-7e398e868fd8 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:38:43.216460 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4a8f0-b3d4-467e-b54b-7e398e868fd8 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:38:43.216587 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4a8f0-b3d4-467e-b54b-7e398e868fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:38:43.234555 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-81c4a8f0-b3d4-467e-b54b-7e398e868fd8 None None] MFA Rules not processed for user `1db35c40e944463587194d432aaf15bb`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:38:43.235739 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-81c4a8f0-b3d4-467e-b54b-7e398e868fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:38:43.243700 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 473/951] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:38:43 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:38:43.281726 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06828d96-5129-4777-8d05-cc0848872409 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:38:43.292870 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06828d96-5129-4777-8d05-cc0848872409 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:38:43.296285 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f638d1d2-63fc-42b5-bac7-c30493eb8ed5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05f1ce71ea7c4301ae0bfc84a06c9c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:38:43.297036 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638d1d2-63fc-42b5-bac7-c30493eb8ed5 service neutron] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:38:43.297393 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638d1d2-63fc-42b5-bac7-c30493eb8ed5 service neutron] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:38:43.297664 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638d1d2-63fc-42b5-bac7-c30493eb8ed5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:38:43.308329 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f638d1d2-63fc-42b5-bac7-c30493eb8ed5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:38:43.309799 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f638d1d2-63fc-42b5-bac7-c30493eb8ed5 service neutron] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:38:43.319998 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 479/952] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:38:43 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:38:45.896360 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e7dbb-6f10-4b34-8e7d-850e2cb399c4 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:38:45.896976 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e7dbb-6f10-4b34-8e7d-850e2cb399c4 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:38:45.896976 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e7dbb-6f10-4b34-8e7d-850e2cb399c4 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:38:45.898316 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 474/953] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:38:45.904245 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd77e5c-c585-4977-879c-50aad61f2d0a None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:38:45.904783 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd77e5c-c585-4977-879c-50aad61f2d0a None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:38:45.904783 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd77e5c-c585-4977-879c-50aad61f2d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:38:45.923565 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-7dd77e5c-c585-4977-879c-50aad61f2d0a None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:38:45.924808 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-7dd77e5c-c585-4977-879c-50aad61f2d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:38:45.933942 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 480/954] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:38:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:38:45.971921 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e7dbb-6f10-4b34-8e7d-850e2cb399c4 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:38:45.983442 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e7dbb-6f10-4b34-8e7d-850e2cb399c4 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:38:45.986829 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489961e-cea4-485e-8043-2a6f24f842d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05f1ce71ea7c4301ae0bfc84a06c9c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:38:45.987455 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489961e-cea4-485e-8043-2a6f24f842d3 service neutron] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:38:45.987735 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489961e-cea4-485e-8043-2a6f24f842d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:38:45.988007 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489961e-cea4-485e-8043-2a6f24f842d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:38:45.996972 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5489961e-cea4-485e-8043-2a6f24f842d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:38:45.998392 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5489961e-cea4-485e-8043-2a6f24f842d3 service neutron] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:38:46.007585 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 475/955] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:38:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:38:48.341939 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d989e4-9048-408b-aaec-8db7ff205d2e None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:38:48.342440 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d989e4-9048-408b-aaec-8db7ff205d2e None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:38:48.342440 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d989e4-9048-408b-aaec-8db7ff205d2e None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:38:48.343755 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 481/956] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:38:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:38:48.349529 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000b9de-f41c-42ef-ba49-287d6f273106 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:38:48.349960 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000b9de-f41c-42ef-ba49-287d6f273106 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:38:48.350098 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000b9de-f41c-42ef-ba49-287d6f273106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:38:48.367805 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-d000b9de-f41c-42ef-ba49-287d6f273106 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:38:48.369600 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-d000b9de-f41c-42ef-ba49-287d6f273106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:38:48.379271 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 476/957] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:38:48 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:38:48.421082 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d989e4-9048-408b-aaec-8db7ff205d2e None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:38:48.426430 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=68 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:38:48.432601 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d989e4-9048-408b-aaec-8db7ff205d2e None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:38:48.436001 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205dd73-3b36-4dfb-bc9c-b24b860ef258 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05f1ce71ea7c4301ae0bfc84a06c9c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:38:48.436627 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205dd73-3b36-4dfb-bc9c-b24b860ef258 service neutron] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:38:48.436935 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205dd73-3b36-4dfb-bc9c-b24b860ef258 service neutron] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:38:48.437210 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205dd73-3b36-4dfb-bc9c-b24b860ef258 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:38:48.446062 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f205dd73-3b36-4dfb-bc9c-b24b860ef258 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:38:48.447472 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f205dd73-3b36-4dfb-bc9c-b24b860ef258 service neutron] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:38:48.456524 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 482/958] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:38:48 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:38:51.068484 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775a44d-6eeb-43b8-89ec-9cfec3c1737f None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:38:51.069055 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775a44d-6eeb-43b8-89ec-9cfec3c1737f None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:38:51.069055 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775a44d-6eeb-43b8-89ec-9cfec3c1737f None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:38:51.070410 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 477/959] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:38:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:38:51.075517 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75470189-c5bc-4ecb-a54e-5d7dfb524c48 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:38:51.075936 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75470189-c5bc-4ecb-a54e-5d7dfb524c48 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:38:51.076048 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75470189-c5bc-4ecb-a54e-5d7dfb524c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:38:51.093974 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-75470189-c5bc-4ecb-a54e-5d7dfb524c48 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:38:51.095155 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-75470189-c5bc-4ecb-a54e-5d7dfb524c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:38:51.102880 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 483/960] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:38:51 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:38:51.140102 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775a44d-6eeb-43b8-89ec-9cfec3c1737f None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:38:51.151255 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775a44d-6eeb-43b8-89ec-9cfec3c1737f None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:38:51.154719 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3ebb0-3e77-44ee-a368-16fc62f36677 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05f1ce71ea7c4301ae0bfc84a06c9c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:38:51.155345 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3ebb0-3e77-44ee-a368-16fc62f36677 service neutron] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:38:51.155626 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3ebb0-3e77-44ee-a368-16fc62f36677 service neutron] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:38:51.155899 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3ebb0-3e77-44ee-a368-16fc62f36677 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:38:51.164561 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3ebb0-3e77-44ee-a368-16fc62f36677 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:38:51.166018 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3ebb0-3e77-44ee-a368-16fc62f36677 service neutron] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:38:51.175181 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 478/961] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:38:51 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:38:55.383095 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c5140-0fee-4976-a306-593341c49103 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:38:55.383595 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c5140-0fee-4976-a306-593341c49103 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:38:55.383595 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c5140-0fee-4976-a306-593341c49103 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:38:55.385144 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 484/962] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:38:55.390312 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac8029-8b72-4143-b823-f3f51020d989 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:38:55.390761 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac8029-8b72-4143-b823-f3f51020d989 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:38:55.390859 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac8029-8b72-4143-b823-f3f51020d989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:38:55.408334 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-37ac8029-8b72-4143-b823-f3f51020d989 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:38:55.409566 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-37ac8029-8b72-4143-b823-f3f51020d989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:38:55.420884 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 479/963] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:38:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 23:38:55.460925 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c5140-0fee-4976-a306-593341c49103 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:38:55.471396 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c5140-0fee-4976-a306-593341c49103 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:38:55.474920 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04223bc-7b41-4b7d-ba43-eac04cf805e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05f1ce71ea7c4301ae0bfc84a06c9c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:38:55.475540 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04223bc-7b41-4b7d-ba43-eac04cf805e8 service neutron] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:38:55.475822 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04223bc-7b41-4b7d-ba43-eac04cf805e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:38:55.476096 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04223bc-7b41-4b7d-ba43-eac04cf805e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:38:55.484699 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04223bc-7b41-4b7d-ba43-eac04cf805e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:38:55.486139 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04223bc-7b41-4b7d-ba43-eac04cf805e8 service neutron] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:38:55.495378 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 485/964] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:38:55 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:38:58.311113 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ab366-b79d-4fa0-8d7b-b602eb0f6662 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:38:58.311633 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ab366-b79d-4fa0-8d7b-b602eb0f6662 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:38:58.311752 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ab366-b79d-4fa0-8d7b-b602eb0f6662 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:38:58.313040 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 480/965] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:38:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:38:58.318960 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056a4c9-3b93-48a6-bc47-072a6ad8f355 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:38:58.319407 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056a4c9-3b93-48a6-bc47-072a6ad8f355 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:38:58.319633 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056a4c9-3b93-48a6-bc47-072a6ad8f355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:38:58.337628 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-1056a4c9-3b93-48a6-bc47-072a6ad8f355 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:38:58.338816 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-1056a4c9-3b93-48a6-bc47-072a6ad8f355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:38:58.346399 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 486/966] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:38:58 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 23:38:58.384635 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ab366-b79d-4fa0-8d7b-b602eb0f6662 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:38:58.396043 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ab366-b79d-4fa0-8d7b-b602eb0f6662 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:38:58.399456 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a01ff-e7b5-4848-b597-3ced35b5a39e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05f1ce71ea7c4301ae0bfc84a06c9c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:38:58.400084 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a01ff-e7b5-4848-b597-3ced35b5a39e service neutron] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:38:58.400365 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a01ff-e7b5-4848-b597-3ced35b5a39e service neutron] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:38:58.400641 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a01ff-e7b5-4848-b597-3ced35b5a39e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:38:58.409768 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a01ff-e7b5-4848-b597-3ced35b5a39e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:38:58.411454 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a01ff-e7b5-4848-b597-3ced35b5a39e service neutron] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:38:58.421072 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 481/967] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:38:58 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:39:02.712037 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14758973-7479-4359-b670-bfc7496454a8 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:02.712523 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14758973-7479-4359-b670-bfc7496454a8 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:02.712523 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14758973-7479-4359-b670-bfc7496454a8 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:02.713901 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 487/968] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:39:02.719064 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c93bfe-ebab-4591-9297-094f57118384 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:02.719472 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c93bfe-ebab-4591-9297-094f57118384 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:02.719618 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c93bfe-ebab-4591-9297-094f57118384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:02.726243 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=54 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:39:02.738901 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-89c93bfe-ebab-4591-9297-094f57118384 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:39:02.740137 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-89c93bfe-ebab-4591-9297-094f57118384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:39:02.748281 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 482/969] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:39:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:39:02.788678 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14758973-7479-4359-b670-bfc7496454a8 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:39:02.800869 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14758973-7479-4359-b670-bfc7496454a8 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:39:02.805075 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a03976-53af-4d8c-bd2c-8a05d8186b05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05f1ce71ea7c4301ae0bfc84a06c9c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:39:02.805716 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a03976-53af-4d8c-bd2c-8a05d8186b05 service neutron] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:02.805997 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a03976-53af-4d8c-bd2c-8a05d8186b05 service neutron] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:02.806268 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a03976-53af-4d8c-bd2c-8a05d8186b05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:02.815430 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a03976-53af-4d8c-bd2c-8a05d8186b05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:39:02.816863 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a03976-53af-4d8c-bd2c-8a05d8186b05 service neutron] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:39:02.826745 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 488/970] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:39:02 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:39:08.393511 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d93791-2dca-41d9-9541-95c8bbf858c9 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:08.394489 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d93791-2dca-41d9-9541-95c8bbf858c9 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:08.394979 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d93791-2dca-41d9-9541-95c8bbf858c9 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:08.397967 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 483/971] 10.222.0.16 () {54 vars in 921 bytes} [Wed Jul 13 23:39:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:39:08.402880 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779ebff-2356-4482-ac5a-88c950f5dc42 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:08.403360 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779ebff-2356-4482-ac5a-88c950f5dc42 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:08.403447 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779ebff-2356-4482-ac5a-88c950f5dc42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:08.455360 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-8779ebff-2356-4482-ac5a-88c950f5dc42 None None] MFA Rules not processed for user `4fbb147d802e48a082c7d928714f1dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:39:08.456926 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-8779ebff-2356-4482-ac5a-88c950f5dc42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:39:08.535700 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 489/972] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Jul 13 23:39:08 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:39:12.733798 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=2 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:39:12.822855 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6693f-4129-4086-8fc9-f942c53ea2d1 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:12.822855 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6693f-4129-4086-8fc9-f942c53ea2d1 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:12.822855 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6693f-4129-4086-8fc9-f942c53ea2d1 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:12.824580 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 484/973] 10.222.0.16 () {54 vars in 921 bytes} [Wed Jul 13 23:39:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:39:12.831114 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fcf45-5786-41af-be4b-59bae3b437df None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:12.831114 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fcf45-5786-41af-be4b-59bae3b437df None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:12.831114 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fcf45-5786-41af-be4b-59bae3b437df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:12.850874 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-6c9fcf45-5786-41af-be4b-59bae3b437df None None] MFA Rules not processed for user `4fbb147d802e48a082c7d928714f1dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:39:12.852060 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-6c9fcf45-5786-41af-be4b-59bae3b437df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:39:12.861218 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 490/974] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Jul 13 23:39:12 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 23:39:14.628988 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b865a-76c4-4a98-b5ba-b7b561aa21d5 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:14.629530 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b865a-76c4-4a98-b5ba-b7b561aa21d5 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:14.629530 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b865a-76c4-4a98-b5ba-b7b561aa21d5 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:14.630898 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 485/975] 10.222.0.16 () {54 vars in 921 bytes} [Wed Jul 13 23:39:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:39:14.635869 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289b3a7-0efe-4e77-89b7-0e8b5c8a615b None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:14.636298 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289b3a7-0efe-4e77-89b7-0e8b5c8a615b None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:14.636408 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289b3a7-0efe-4e77-89b7-0e8b5c8a615b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:14.654968 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-9289b3a7-0efe-4e77-89b7-0e8b5c8a615b None None] MFA Rules not processed for user `4fbb147d802e48a082c7d928714f1dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:39:14.656194 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-9289b3a7-0efe-4e77-89b7-0e8b5c8a615b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:39:14.665534 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 491/976] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Jul 13 23:39:14 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 23:39:18.683461 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3684d74-bbf1-4cc9-92f0-b1396358af7d None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:18.684024 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3684d74-bbf1-4cc9-92f0-b1396358af7d None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:18.684269 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3684d74-bbf1-4cc9-92f0-b1396358af7d None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:18.685811 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 486/977] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:39:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:39:18.690985 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47257796-0513-4a2c-997d-febb67d6332f None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:18.691388 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47257796-0513-4a2c-997d-febb67d6332f None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:18.691538 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47257796-0513-4a2c-997d-febb67d6332f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:18.700133 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=69 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:39:18.712891 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-47257796-0513-4a2c-997d-febb67d6332f None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:39:18.714079 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-47257796-0513-4a2c-997d-febb67d6332f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:39:18.722051 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 492/978] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:39:18 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:39:18.785714 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b7872-cca3-4426-be01-6b1c4ecddac7 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:18.786979 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b7872-cca3-4426-be01-6b1c4ecddac7 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:18.787627 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b7872-cca3-4426-be01-6b1c4ecddac7 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:18.789711 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 487/979] 10.222.0.16 () {54 vars in 961 bytes} [Wed Jul 13 23:39:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:39:18.800224 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53771dc6-9778-4c0d-ad4a-cd0ce3c26026 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:18.800517 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53771dc6-9778-4c0d-ad4a-cd0ce3c26026 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:18.800799 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53771dc6-9778-4c0d-ad4a-cd0ce3c26026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:18.839158 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-53771dc6-9778-4c0d-ad4a-cd0ce3c26026 None None] MFA Rules not processed for user `a7e276c4bd434c028274e059a73c4060`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:39:18.840328 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-53771dc6-9778-4c0d-ad4a-cd0ce3c26026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:39:18.914426 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 493/980] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Jul 13 23:39:18 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:39:18.921972 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b7872-cca3-4426-be01-6b1c4ecddac7 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:39:18.937027 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b7872-cca3-4426-be01-6b1c4ecddac7 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:39:18.941869 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16c99f-47ba-4844-9866-9cf331b7947c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e276c4bd434c028274e059a73c4060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:39:18.943165 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16c99f-47ba-4844-9866-9cf331b7947c service nova] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:18.943519 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16c99f-47ba-4844-9866-9cf331b7947c service nova] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:18.943869 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16c99f-47ba-4844-9866-9cf331b7947c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:18.952786 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e16c99f-47ba-4844-9866-9cf331b7947c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:39:18.954586 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e16c99f-47ba-4844-9866-9cf331b7947c service nova] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:39:18.964603 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 488/981] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:39:18 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:39:21.445308 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92677a-606c-44c5-907d-fcb9e3aebf24 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:21.445864 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92677a-606c-44c5-907d-fcb9e3aebf24 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:21.445864 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92677a-606c-44c5-907d-fcb9e3aebf24 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:21.447404 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 494/982] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:39:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:39:21.452357 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79800fca-7e5c-48b6-afd5-84e1340164d4 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:21.452747 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79800fca-7e5c-48b6-afd5-84e1340164d4 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:21.452979 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79800fca-7e5c-48b6-afd5-84e1340164d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:21.471826 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-79800fca-7e5c-48b6-afd5-84e1340164d4 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:39:21.473067 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-79800fca-7e5c-48b6-afd5-84e1340164d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:39:21.481010 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 489/983] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:39:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:39:21.529554 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92677a-606c-44c5-907d-fcb9e3aebf24 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:39:21.544333 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92677a-606c-44c5-907d-fcb9e3aebf24 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:39:21.553219 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc1eac5-7902-4e0b-9609-0d828a25237b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e276c4bd434c028274e059a73c4060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:39:21.553968 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1eac5-7902-4e0b-9609-0d828a25237b service nova] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:21.554318 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1eac5-7902-4e0b-9609-0d828a25237b service nova] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:21.554663 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1eac5-7902-4e0b-9609-0d828a25237b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:21.564589 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc1eac5-7902-4e0b-9609-0d828a25237b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:39:21.566624 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc1eac5-7902-4e0b-9609-0d828a25237b service nova] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:39:21.579257 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 495/984] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:39:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:39:24.193642 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7adb7b-d7dd-4920-91ae-0ccb00bcaae2 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:24.194120 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7adb7b-d7dd-4920-91ae-0ccb00bcaae2 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:24.194284 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7adb7b-d7dd-4920-91ae-0ccb00bcaae2 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:24.196259 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 490/985] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:39:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:39:24.201384 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e187b07-42a1-4bdd-9c58-53845a0b0817 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:24.201798 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e187b07-42a1-4bdd-9c58-53845a0b0817 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:24.201952 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e187b07-42a1-4bdd-9c58-53845a0b0817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:24.219983 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-9e187b07-42a1-4bdd-9c58-53845a0b0817 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:39:24.221176 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-9e187b07-42a1-4bdd-9c58-53845a0b0817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:39:24.230521 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 496/986] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:39:24 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:39:24.283218 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f525f-1be2-4935-86e2-4c0e6c56fd1e None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:24.283519 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f525f-1be2-4935-86e2-4c0e6c56fd1e None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:24.283791 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f525f-1be2-4935-86e2-4c0e6c56fd1e None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:24.285424 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 491/987] 10.222.0.16 () {54 vars in 961 bytes} [Wed Jul 13 23:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:39:24.291518 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f321acd-7519-47c5-99b0-923e73f8aeed None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:24.291804 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f321acd-7519-47c5-99b0-923e73f8aeed None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:24.292079 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f321acd-7519-47c5-99b0-923e73f8aeed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:24.312248 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-4f321acd-7519-47c5-99b0-923e73f8aeed None None] MFA Rules not processed for user `a7e276c4bd434c028274e059a73c4060`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:39:24.313403 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-4f321acd-7519-47c5-99b0-923e73f8aeed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:39:24.323013 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 497/988] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Jul 13 23:39:24 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:39:24.330767 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f525f-1be2-4935-86e2-4c0e6c56fd1e None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:39:24.344134 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f525f-1be2-4935-86e2-4c0e6c56fd1e None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:39:24.349081 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5602c49e-56f5-4cde-aae3-2b638113d0f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e276c4bd434c028274e059a73c4060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:39:24.349711 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602c49e-56f5-4cde-aae3-2b638113d0f2 service nova] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:24.349993 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602c49e-56f5-4cde-aae3-2b638113d0f2 service nova] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:24.350269 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602c49e-56f5-4cde-aae3-2b638113d0f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:24.358183 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5602c49e-56f5-4cde-aae3-2b638113d0f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:39:24.359787 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5602c49e-56f5-4cde-aae3-2b638113d0f2 service nova] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:39:24.369488 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 492/989] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:39:24 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:39:26.690436 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f4553-06a9-4516-afef-3fe4801e9307 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:26.691475 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f4553-06a9-4516-afef-3fe4801e9307 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:26.692007 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f4553-06a9-4516-afef-3fe4801e9307 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:26.698375 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 498/990] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:39:26 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:39:26.699847 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155704e-6bbf-4032-8409-8e676480d584 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:26.700233 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155704e-6bbf-4032-8409-8e676480d584 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:26.700421 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155704e-6bbf-4032-8409-8e676480d584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:26.721121 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-d155704e-6bbf-4032-8409-8e676480d584 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:39:26.722742 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-d155704e-6bbf-4032-8409-8e676480d584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:39:26.740575 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 493/991] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:39:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 23:39:26.779995 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f4553-06a9-4516-afef-3fe4801e9307 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:39:26.795078 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f4553-06a9-4516-afef-3fe4801e9307 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:39:26.800361 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ca919-3e9a-4487-abc1-b2a6fcdc73c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e276c4bd434c028274e059a73c4060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:39:26.801378 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ca919-3e9a-4487-abc1-b2a6fcdc73c0 service nova] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:26.801886 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ca919-3e9a-4487-abc1-b2a6fcdc73c0 service nova] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:26.802378 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ca919-3e9a-4487-abc1-b2a6fcdc73c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:26.811645 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ca919-3e9a-4487-abc1-b2a6fcdc73c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:39:26.813595 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ca919-3e9a-4487-abc1-b2a6fcdc73c0 service nova] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:39:26.836502 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 499/992] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:39:26 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:39:28.825445 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ba6de-3422-4061-a748-be0aaa76b82c None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:28.826553 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ba6de-3422-4061-a748-be0aaa76b82c None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:28.827225 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ba6de-3422-4061-a748-be0aaa76b82c None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:28.837129 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e64d1-76c1-4702-854a-aa2817537b5b None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:28.837896 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e64d1-76c1-4702-854a-aa2817537b5b None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:28.838325 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e64d1-76c1-4702-854a-aa2817537b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:28.840519 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 494/993] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:39:28 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:39:28.858568 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-b67e64d1-76c1-4702-854a-aa2817537b5b None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:39:28.859955 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-b67e64d1-76c1-4702-854a-aa2817537b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:39:28.869741 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 500/994] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:39:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:39:29.192312 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fe493-44d5-4d7c-a96f-e956690e2dbd None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:29.192646 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fe493-44d5-4d7c-a96f-e956690e2dbd None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:29.193002 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fe493-44d5-4d7c-a96f-e956690e2dbd None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:29.195151 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 495/995] 10.222.0.16 () {54 vars in 963 bytes} [Wed Jul 13 23:39:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:39:29.201060 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7946fc4-8e4e-4238-9cc9-a046a27e0933 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:29.201407 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7946fc4-8e4e-4238-9cc9-a046a27e0933 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:29.201653 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7946fc4-8e4e-4238-9cc9-a046a27e0933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:29.242519 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-c7946fc4-8e4e-4238-9cc9-a046a27e0933 None None] MFA Rules not processed for user `ce654da79295477792be5ddb6e60ff12`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:39:29.243805 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-c7946fc4-8e4e-4238-9cc9-a046a27e0933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:39:29.256243 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64a662-6ef6-420e-b6f9-d8527cbd3011 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:29.256531 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64a662-6ef6-420e-b6f9-d8527cbd3011 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:29.257063 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64a662-6ef6-420e-b6f9-d8527cbd3011 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:29.258402 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 496/996] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:39:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:39:29.263597 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96346f0-9ea0-48e7-a16e-ef429dc747e6 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:29.264069 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96346f0-9ea0-48e7-a16e-ef429dc747e6 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:29.264410 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96346f0-9ea0-48e7-a16e-ef429dc747e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:29.286506 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-e96346f0-9ea0-48e7-a16e-ef429dc747e6 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:39:29.288477 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-e96346f0-9ea0-48e7-a16e-ef429dc747e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:39:29.296599 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 497/997] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:39:29 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 23:39:29.310210 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 501/998] 10.222.0.16 () {58 vars in 1060 bytes} [Wed Jul 13 23:39:29 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:39:29.318650 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96346f0-9ea0-48e7-a16e-ef429dc747e6 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:39:29.328403 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96346f0-9ea0-48e7-a16e-ef429dc747e6 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:39:29.334924 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eaf704-0dc9-4899-b377-25e7f992c326 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce654da79295477792be5ddb6e60ff12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:39:29.334924 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eaf704-0dc9-4899-b377-25e7f992c326 service cinder] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:29.334924 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eaf704-0dc9-4899-b377-25e7f992c326 service cinder] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:29.334924 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eaf704-0dc9-4899-b377-25e7f992c326 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:29.341814 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7946fc4-8e4e-4238-9cc9-a046a27e0933 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:39:29.344659 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eaf704-0dc9-4899-b377-25e7f992c326 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:39:29.346113 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eaf704-0dc9-4899-b377-25e7f992c326 service cinder] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:39:29.355664 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7946fc4-8e4e-4238-9cc9-a046a27e0933 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:39:29.356502 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 498/999] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:39:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 23:39:29.361381 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b80f3e-78f0-43b4-9962-541da1a73f2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e276c4bd434c028274e059a73c4060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:39:29.362038 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b80f3e-78f0-43b4-9962-541da1a73f2a service nova] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:29.362326 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b80f3e-78f0-43b4-9962-541da1a73f2a service nova] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:29.362608 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b80f3e-78f0-43b4-9962-541da1a73f2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:29.372171 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b80f3e-78f0-43b4-9962-541da1a73f2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:39:29.373823 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b80f3e-78f0-43b4-9962-541da1a73f2a service nova] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:39:29.377870 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=100 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:39:29.385714 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 502/1000] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:39:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 23:39:31.684056 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee46f9f-d6c9-49c9-88aa-a7e0a9934b8c None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:31.684500 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee46f9f-d6c9-49c9-88aa-a7e0a9934b8c None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:31.684644 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee46f9f-d6c9-49c9-88aa-a7e0a9934b8c None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:31.685980 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 499/1001] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:39:31.691129 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc8d4c-6f03-43d3-bc90-b911585e4bb1 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:31.691538 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc8d4c-6f03-43d3-bc90-b911585e4bb1 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:31.691699 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc8d4c-6f03-43d3-bc90-b911585e4bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:31.712695 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-8bdc8d4c-6f03-43d3-bc90-b911585e4bb1 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:39:31.714042 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-8bdc8d4c-6f03-43d3-bc90-b911585e4bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:39:31.722697 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 503/1002] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:39:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 23:39:31.771171 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee46f9f-d6c9-49c9-88aa-a7e0a9934b8c None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:39:31.785166 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee46f9f-d6c9-49c9-88aa-a7e0a9934b8c None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:39:31.790712 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff519de-48ed-40d7-b767-3a82cf2219e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e276c4bd434c028274e059a73c4060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:39:31.791358 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff519de-48ed-40d7-b767-3a82cf2219e7 service nova] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:31.791644 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff519de-48ed-40d7-b767-3a82cf2219e7 service nova] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:31.791921 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff519de-48ed-40d7-b767-3a82cf2219e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:31.801400 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff519de-48ed-40d7-b767-3a82cf2219e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:39:31.803018 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff519de-48ed-40d7-b767-3a82cf2219e7 service nova] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:39:31.812987 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 500/1003] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:39:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:39:34.119043 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124252e-79d7-4018-8202-b896eb99da96 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:34.119585 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124252e-79d7-4018-8202-b896eb99da96 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:34.119585 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124252e-79d7-4018-8202-b896eb99da96 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:34.120963 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 504/1004] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:39:34.126290 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfcc34-c018-441a-9b2a-872457e75c67 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:34.126692 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfcc34-c018-441a-9b2a-872457e75c67 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:34.126857 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfcc34-c018-441a-9b2a-872457e75c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:34.145898 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-5acfcc34-c018-441a-9b2a-872457e75c67 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:39:34.147088 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-5acfcc34-c018-441a-9b2a-872457e75c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:39:34.155036 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 501/1005] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:39:34 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:39:34.203380 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124252e-79d7-4018-8202-b896eb99da96 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:39:34.219293 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124252e-79d7-4018-8202-b896eb99da96 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:39:34.226260 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f336638-4dba-4ab7-94a4-33db49a4a55d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e276c4bd434c028274e059a73c4060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:39:34.226903 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f336638-4dba-4ab7-94a4-33db49a4a55d service nova] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:34.227185 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f336638-4dba-4ab7-94a4-33db49a4a55d service nova] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:34.227529 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f336638-4dba-4ab7-94a4-33db49a4a55d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:34.236655 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f336638-4dba-4ab7-94a4-33db49a4a55d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:39:34.238268 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f336638-4dba-4ab7-94a4-33db49a4a55d service nova] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:39:34.250442 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 505/1006] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:39:34 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:39:36.508716 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddff671-c678-4ab8-98ef-95cd5f80157e None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:36.509310 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddff671-c678-4ab8-98ef-95cd5f80157e None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:36.509310 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddff671-c678-4ab8-98ef-95cd5f80157e None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:36.510658 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 502/1007] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:39:36.516077 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec7ba4-5a50-4ea8-9c89-0fad2d55983b None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:36.516500 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec7ba4-5a50-4ea8-9c89-0fad2d55983b None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:36.516631 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec7ba4-5a50-4ea8-9c89-0fad2d55983b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:36.534813 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-aeec7ba4-5a50-4ea8-9c89-0fad2d55983b None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:39:36.536641 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-aeec7ba4-5a50-4ea8-9c89-0fad2d55983b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:39:36.547837 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 506/1008] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:39:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:39:36.593463 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddff671-c678-4ab8-98ef-95cd5f80157e None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:39:36.608287 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddff671-c678-4ab8-98ef-95cd5f80157e None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:39:36.613529 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d9e0a-9520-4756-bc85-30e7c80ff778 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e276c4bd434c028274e059a73c4060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:39:36.614375 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d9e0a-9520-4756-bc85-30e7c80ff778 service nova] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:36.614895 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d9e0a-9520-4756-bc85-30e7c80ff778 service nova] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:36.615303 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d9e0a-9520-4756-bc85-30e7c80ff778 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:36.624628 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d9e0a-9520-4756-bc85-30e7c80ff778 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:39:36.626551 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d9e0a-9520-4756-bc85-30e7c80ff778 service nova] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:39:36.638237 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 503/1009] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:39:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:39:38.937694 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d3068-9921-43a9-a6ad-73f1beb43a26 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:38.938264 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d3068-9921-43a9-a6ad-73f1beb43a26 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:38.938264 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d3068-9921-43a9-a6ad-73f1beb43a26 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:38.939610 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 507/1010] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 23:39:38.945466 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ac20d-4c83-4688-aef3-85cf3f9f6998 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:38.945923 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ac20d-4c83-4688-aef3-85cf3f9f6998 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:38.946036 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ac20d-4c83-4688-aef3-85cf3f9f6998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:38.963843 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-947ac20d-4c83-4688-aef3-85cf3f9f6998 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:39:38.965084 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-947ac20d-4c83-4688-aef3-85cf3f9f6998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:39:38.972936 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 504/1011] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:39:38 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:39:39.023189 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d3068-9921-43a9-a6ad-73f1beb43a26 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:39:39.037295 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d3068-9921-43a9-a6ad-73f1beb43a26 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:39:39.042330 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed49109-3d27-4598-b4e8-6bd145992875 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e276c4bd434c028274e059a73c4060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:39:39.042998 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed49109-3d27-4598-b4e8-6bd145992875 service nova] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:39.043279 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed49109-3d27-4598-b4e8-6bd145992875 service nova] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:39.043551 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed49109-3d27-4598-b4e8-6bd145992875 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:39.053851 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed49109-3d27-4598-b4e8-6bd145992875 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:39:39.055518 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed49109-3d27-4598-b4e8-6bd145992875 service nova] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:39:39.065993 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 508/1012] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:39:39 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:39:41.704128 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d284022-138f-495c-a7cd-f5b6a7dd504d None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:41.704753 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d284022-138f-495c-a7cd-f5b6a7dd504d None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:41.704753 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d284022-138f-495c-a7cd-f5b6a7dd504d None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:41.706074 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 505/1013] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:39:41.712061 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea174d4f-1ebd-4cda-bc74-cdeb64e6fd53 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:41.712541 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea174d4f-1ebd-4cda-bc74-cdeb64e6fd53 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:41.712653 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea174d4f-1ebd-4cda-bc74-cdeb64e6fd53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:41.731567 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-ea174d4f-1ebd-4cda-bc74-cdeb64e6fd53 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:39:41.732770 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-ea174d4f-1ebd-4cda-bc74-cdeb64e6fd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:39:41.741299 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 509/1014] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:39:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:39:41.787706 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d284022-138f-495c-a7cd-f5b6a7dd504d None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:39:41.807994 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d284022-138f-495c-a7cd-f5b6a7dd504d None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:39:41.814838 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd83af52-00b6-4768-b098-602983e786df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e276c4bd434c028274e059a73c4060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:39:41.815853 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83af52-00b6-4768-b098-602983e786df service nova] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:41.816568 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83af52-00b6-4768-b098-602983e786df service nova] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:41.818214 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83af52-00b6-4768-b098-602983e786df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:41.829745 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd83af52-00b6-4768-b098-602983e786df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:39:41.831731 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd83af52-00b6-4768-b098-602983e786df service nova] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:39:41.846003 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 506/1015] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:39:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:39:44.694668 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825b8d9-5392-43a4-a066-9b3600342125 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:44.695321 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825b8d9-5392-43a4-a066-9b3600342125 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:44.695321 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825b8d9-5392-43a4-a066-9b3600342125 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:44.696585 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 510/1016] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:39:44.701744 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c02dc-4582-45ec-b83a-827e2fc61cd8 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:44.702188 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c02dc-4582-45ec-b83a-827e2fc61cd8 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:44.702301 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c02dc-4582-45ec-b83a-827e2fc61cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:44.710265 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=52 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:39:44.724408 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-bc4c02dc-4582-45ec-b83a-827e2fc61cd8 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:39:44.725625 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-bc4c02dc-4582-45ec-b83a-827e2fc61cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:39:44.734843 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 507/1017] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:39:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:39:44.778895 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4825b8d9-5392-43a4-a066-9b3600342125 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:39:44.793006 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4825b8d9-5392-43a4-a066-9b3600342125 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:39:44.797876 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa2d992-2939-4816-91d0-d842ead35755 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e276c4bd434c028274e059a73c4060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:39:44.798457 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2d992-2939-4816-91d0-d842ead35755 service nova] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:44.798740 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2d992-2939-4816-91d0-d842ead35755 service nova] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:44.799017 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2d992-2939-4816-91d0-d842ead35755 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:44.807225 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa2d992-2939-4816-91d0-d842ead35755 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:39:44.808797 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa2d992-2939-4816-91d0-d842ead35755 service nova] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:39:44.818735 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 511/1018] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:39:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:39:45.415054 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2650e2-d874-4e68-83df-510c81e61250 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:45.415346 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2650e2-d874-4e68-83df-510c81e61250 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:45.415629 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2650e2-d874-4e68-83df-510c81e61250 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:45.417013 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 508/1019] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:39:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:39:45.422145 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e593482-1c43-4a05-a5b6-ae541bbb13a1 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:45.422434 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e593482-1c43-4a05-a5b6-ae541bbb13a1 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:45.422710 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e593482-1c43-4a05-a5b6-ae541bbb13a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:45.440919 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-6e593482-1c43-4a05-a5b6-ae541bbb13a1 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:39:45.442730 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-6e593482-1c43-4a05-a5b6-ae541bbb13a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:39:45.450512 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 512/1020] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:39:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:39:45.507673 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e6e1d-26d2-4da5-a3c4-2ea18f6fa9aa None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:45.507969 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e6e1d-26d2-4da5-a3c4-2ea18f6fa9aa None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:45.508264 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e6e1d-26d2-4da5-a3c4-2ea18f6fa9aa None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:45.509623 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 509/1021] 10.222.0.16 () {54 vars in 962 bytes} [Wed Jul 13 23:39:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:39:45.514950 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997afa73-69bc-4461-898c-ddf6cfaeb6db None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:45.515240 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997afa73-69bc-4461-898c-ddf6cfaeb6db None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:45.515516 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997afa73-69bc-4461-898c-ddf6cfaeb6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:45.555088 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-997afa73-69bc-4461-898c-ddf6cfaeb6db None None] MFA Rules not processed for user `15cdeb3131bc419f98ab11aaa4562d19`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:39:45.556296 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-997afa73-69bc-4461-898c-ddf6cfaeb6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:39:45.616692 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 513/1022] 10.222.0.16 () {58 vars in 1059 bytes} [Wed Jul 13 23:39:45 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:39:45.624364 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e6e1d-26d2-4da5-a3c4-2ea18f6fa9aa None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:39:45.635659 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e6e1d-26d2-4da5-a3c4-2ea18f6fa9aa None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:39:45.639340 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8702392-9251-4002-b260-165b0da86a0e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cdeb3131bc419f98ab11aaa4562d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:39:45.639969 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8702392-9251-4002-b260-165b0da86a0e service glance] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:45.640247 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8702392-9251-4002-b260-165b0da86a0e service glance] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:45.640515 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8702392-9251-4002-b260-165b0da86a0e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:45.651172 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8702392-9251-4002-b260-165b0da86a0e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:39:45.651919 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8702392-9251-4002-b260-165b0da86a0e service glance] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:39:45.661307 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 510/1023] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:39:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:39:47.141236 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65d2b3-8fc9-4684-b8db-17de779b5258 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:47.141955 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65d2b3-8fc9-4684-b8db-17de779b5258 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:47.141955 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65d2b3-8fc9-4684-b8db-17de779b5258 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:47.143148 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 514/1024] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:39:47.148423 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa6e11-0c57-4d6e-bf69-21b050a154bf None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:47.149002 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa6e11-0c57-4d6e-bf69-21b050a154bf None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:47.149002 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa6e11-0c57-4d6e-bf69-21b050a154bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:47.168190 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-59aa6e11-0c57-4d6e-bf69-21b050a154bf None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:39:47.169422 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-59aa6e11-0c57-4d6e-bf69-21b050a154bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:39:47.177840 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 511/1025] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:39:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:39:47.224043 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65d2b3-8fc9-4684-b8db-17de779b5258 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:39:47.237296 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65d2b3-8fc9-4684-b8db-17de779b5258 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:39:47.243297 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668dc2ed-032d-4c37-bed7-713861c2192c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e276c4bd434c028274e059a73c4060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:39:47.243933 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668dc2ed-032d-4c37-bed7-713861c2192c service nova] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:39:47.244220 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668dc2ed-032d-4c37-bed7-713861c2192c service nova] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:39:47.244505 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668dc2ed-032d-4c37-bed7-713861c2192c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:39:47.252979 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668dc2ed-032d-4c37-bed7-713861c2192c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:39:47.255273 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668dc2ed-032d-4c37-bed7-713861c2192c service nova] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:39:47.265360 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 515/1026] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:39:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:39:57.161715 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=11 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:39:57.260529 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=70 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:40:00.853374 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c2ee4-5d18-4ab9-a2f7-77a4a4f1ecd1 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:00.854022 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c2ee4-5d18-4ab9-a2f7-77a4a4f1ecd1 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:00.854022 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c2ee4-5d18-4ab9-a2f7-77a4a4f1ecd1 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:00.855262 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 512/1027] 10.222.0.16 () {54 vars in 918 bytes} [Wed Jul 13 23:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:40:00.860182 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd75e30-f921-465c-b885-86abe69143c3 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:00.860655 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd75e30-f921-465c-b885-86abe69143c3 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:00.860767 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd75e30-f921-465c-b885-86abe69143c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:00.879613 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-bcd75e30-f921-465c-b885-86abe69143c3 None None] MFA Rules not processed for user `4fbb147d802e48a082c7d928714f1dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:40:00.881140 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-bcd75e30-f921-465c-b885-86abe69143c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:40:00.890069 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 516/1028] 10.222.0.16 () {58 vars in 1015 bytes} [Wed Jul 13 23:40:00 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:40:00.904999 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6c270-0b6d-4b3c-b6da-227591ab87ea None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:00.905293 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6c270-0b6d-4b3c-b6da-227591ab87ea None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:00.905568 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6c270-0b6d-4b3c-b6da-227591ab87ea None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:00.906880 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 513/1029] 10.222.0.16 () {54 vars in 918 bytes} [Wed Jul 13 23:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:40:00.911975 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a19313-1a37-449f-9b20-b2142398639f None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:00.912266 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a19313-1a37-449f-9b20-b2142398639f None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:00.912543 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a19313-1a37-449f-9b20-b2142398639f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:00.931095 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-36a19313-1a37-449f-9b20-b2142398639f None None] MFA Rules not processed for user `a7e276c4bd434c028274e059a73c4060`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:40:00.932294 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-36a19313-1a37-449f-9b20-b2142398639f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:40:00.941271 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 517/1030] 10.222.0.16 () {58 vars in 1015 bytes} [Wed Jul 13 23:40:00 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:40:03.658618 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86eb29e-aa5b-4b21-a4fd-c9c8f35e42b0 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:03.659110 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86eb29e-aa5b-4b21-a4fd-c9c8f35e42b0 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:03.659215 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86eb29e-aa5b-4b21-a4fd-c9c8f35e42b0 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:03.660532 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 514/1031] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 23:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:40:03.665595 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2602095-e884-46cf-b40a-144e118d1a1d None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:03.666050 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2602095-e884-46cf-b40a-144e118d1a1d None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:03.666158 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2602095-e884-46cf-b40a-144e118d1a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:03.683365 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-d2602095-e884-46cf-b40a-144e118d1a1d None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:40:03.684543 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-d2602095-e884-46cf-b40a-144e118d1a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:40:03.692912 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 518/1032] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 23:40:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:40:03.735725 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86eb29e-aa5b-4b21-a4fd-c9c8f35e42b0 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:40:03.748744 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86eb29e-aa5b-4b21-a4fd-c9c8f35e42b0 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:40:03.753542 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed6ab1-c7ea-4a02-ae81-b754cf09ce11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e276c4bd434c028274e059a73c4060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:40:03.754866 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed6ab1-c7ea-4a02-ae81-b754cf09ce11 service nova] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:03.755157 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed6ab1-c7ea-4a02-ae81-b754cf09ce11 service nova] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:03.755433 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed6ab1-c7ea-4a02-ae81-b754cf09ce11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:03.763453 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed6ab1-c7ea-4a02-ae81-b754cf09ce11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:40:03.765311 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed6ab1-c7ea-4a02-ae81-b754cf09ce11 service nova] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:40:03.775072 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 515/1033] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:40:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:40:04.722332 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67861abf-c44c-459a-b55c-7ada15234826 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:04.723537 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67861abf-c44c-459a-b55c-7ada15234826 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:04.724022 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67861abf-c44c-459a-b55c-7ada15234826 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:04.725444 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 519/1034] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 23:40:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:40:04.730391 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b5790-eb00-4c7c-a826-1f108a4a89bd None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:04.730820 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b5790-eb00-4c7c-a826-1f108a4a89bd None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:04.730941 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b5790-eb00-4c7c-a826-1f108a4a89bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:04.748961 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-157b5790-eb00-4c7c-a826-1f108a4a89bd None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:40:04.750169 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-157b5790-eb00-4c7c-a826-1f108a4a89bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:40:04.757979 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 516/1035] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 23:40:04 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 23:40:04.955472 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67861abf-c44c-459a-b55c-7ada15234826 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:40:04.969332 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67861abf-c44c-459a-b55c-7ada15234826 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:40:04.974918 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c235ec-a5f7-450b-88be-5a9a44627ac5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e276c4bd434c028274e059a73c4060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:40:04.975552 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c235ec-a5f7-450b-88be-5a9a44627ac5 service nova] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:04.975838 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c235ec-a5f7-450b-88be-5a9a44627ac5 service nova] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:04.976114 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c235ec-a5f7-450b-88be-5a9a44627ac5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:04.984075 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c235ec-a5f7-450b-88be-5a9a44627ac5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:40:04.985694 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c235ec-a5f7-450b-88be-5a9a44627ac5 service nova] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:40:04.995025 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 520/1036] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:40:04 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:40:05.899749 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723c942-1a85-4af9-b31b-e2c51b7c7a63 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:05.900277 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723c942-1a85-4af9-b31b-e2c51b7c7a63 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:05.900401 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723c942-1a85-4af9-b31b-e2c51b7c7a63 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:05.901688 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 517/1037] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 23:40:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:40:05.906593 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22186a-9fd8-4685-8524-56518593d95d None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:05.907109 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22186a-9fd8-4685-8524-56518593d95d None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:05.907273 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22186a-9fd8-4685-8524-56518593d95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:05.926790 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-ed22186a-9fd8-4685-8524-56518593d95d None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:40:05.928006 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-ed22186a-9fd8-4685-8524-56518593d95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:40:05.935847 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 521/1038] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 23:40:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:40:06.093185 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9723c942-1a85-4af9-b31b-e2c51b7c7a63 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:40:06.106962 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9723c942-1a85-4af9-b31b-e2c51b7c7a63 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:40:06.112121 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083dd3b-fb17-47f9-bcbb-27acace0f6e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e276c4bd434c028274e059a73c4060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:40:06.112758 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083dd3b-fb17-47f9-bcbb-27acace0f6e4 service nova] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:06.113069 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083dd3b-fb17-47f9-bcbb-27acace0f6e4 service nova] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:06.114128 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083dd3b-fb17-47f9-bcbb-27acace0f6e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:06.122908 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083dd3b-fb17-47f9-bcbb-27acace0f6e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:40:06.124464 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083dd3b-fb17-47f9-bcbb-27acace0f6e4 service nova] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:40:06.133637 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 518/1039] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:40:06 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:40:06.997470 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7524b51-59fd-4d8c-b471-9580a7a906ec None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:06.998055 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7524b51-59fd-4d8c-b471-9580a7a906ec None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:06.998055 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7524b51-59fd-4d8c-b471-9580a7a906ec None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:06.999407 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 522/1040] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 23:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:40:07.004941 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec6ab3-64ed-4a9e-89a4-da5cd48fa67f None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:07.005347 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec6ab3-64ed-4a9e-89a4-da5cd48fa67f None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:07.005497 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec6ab3-64ed-4a9e-89a4-da5cd48fa67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:07.023172 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-4bec6ab3-64ed-4a9e-89a4-da5cd48fa67f None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:40:07.024370 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-4bec6ab3-64ed-4a9e-89a4-da5cd48fa67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:40:07.032024 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 519/1041] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 23:40:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:40:07.186028 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7524b51-59fd-4d8c-b471-9580a7a906ec None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:40:07.199707 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7524b51-59fd-4d8c-b471-9580a7a906ec None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:40:07.204536 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f199323c-3a2e-46ca-a939-6a67519ab298 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e276c4bd434c028274e059a73c4060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:40:07.205191 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199323c-3a2e-46ca-a939-6a67519ab298 service nova] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:07.205476 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199323c-3a2e-46ca-a939-6a67519ab298 service nova] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:07.205752 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199323c-3a2e-46ca-a939-6a67519ab298 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:07.213850 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f199323c-3a2e-46ca-a939-6a67519ab298 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:40:07.215663 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f199323c-3a2e-46ca-a939-6a67519ab298 service nova] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:40:07.226159 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 523/1042] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:40:07 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:40:08.091608 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9950a-19ea-43dc-9fe5-94ddac234576 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:08.092185 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9950a-19ea-43dc-9fe5-94ddac234576 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:08.092185 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9950a-19ea-43dc-9fe5-94ddac234576 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:08.093563 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 520/1043] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 23:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:40:08.098853 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75444a-dc12-4482-a279-601516f37bc5 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:08.099318 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75444a-dc12-4482-a279-601516f37bc5 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:08.099318 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75444a-dc12-4482-a279-601516f37bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:08.117627 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-ff75444a-dc12-4482-a279-601516f37bc5 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:40:08.118813 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-ff75444a-dc12-4482-a279-601516f37bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:40:08.126494 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 524/1044] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 23:40:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:40:08.283259 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa9950a-19ea-43dc-9fe5-94ddac234576 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:40:08.297045 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa9950a-19ea-43dc-9fe5-94ddac234576 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:40:08.302182 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33cc4c-62e3-404b-bf96-607d7879b457 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e276c4bd434c028274e059a73c4060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:40:08.302820 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33cc4c-62e3-404b-bf96-607d7879b457 service nova] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:08.303104 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33cc4c-62e3-404b-bf96-607d7879b457 service nova] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:08.303405 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33cc4c-62e3-404b-bf96-607d7879b457 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:08.311442 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33cc4c-62e3-404b-bf96-607d7879b457 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:40:08.313049 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33cc4c-62e3-404b-bf96-607d7879b457 service nova] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:40:08.323019 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 521/1045] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:40:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:40:09.139559 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7fdbc1-8c33-4392-a9d4-878a8af14b29 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:09.140127 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7fdbc1-8c33-4392-a9d4-878a8af14b29 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:09.140127 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7fdbc1-8c33-4392-a9d4-878a8af14b29 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:09.141533 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 525/1046] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 23:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:40:09.147043 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a46dd-32d1-4898-8905-5fc8e9190f6b None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:09.147496 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a46dd-32d1-4898-8905-5fc8e9190f6b None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:09.147599 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a46dd-32d1-4898-8905-5fc8e9190f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:09.165132 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-610a46dd-32d1-4898-8905-5fc8e9190f6b None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:40:09.166318 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-610a46dd-32d1-4898-8905-5fc8e9190f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:40:09.174041 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 522/1047] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 23:40:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:40:09.333519 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7fdbc1-8c33-4392-a9d4-878a8af14b29 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:40:09.346732 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7fdbc1-8c33-4392-a9d4-878a8af14b29 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:40:09.351653 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f67cad-c306-4084-9678-044441adb66f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e276c4bd434c028274e059a73c4060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:40:09.352281 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f67cad-c306-4084-9678-044441adb66f service nova] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:09.352565 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f67cad-c306-4084-9678-044441adb66f service nova] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:09.352872 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f67cad-c306-4084-9678-044441adb66f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:09.360852 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f67cad-c306-4084-9678-044441adb66f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:40:09.362408 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f67cad-c306-4084-9678-044441adb66f service nova] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:40:09.372180 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 526/1048] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:40:09 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:40:10.198848 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b28d9a-36ea-4ee1-8b69-841f0b88f8e0 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:10.199462 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b28d9a-36ea-4ee1-8b69-841f0b88f8e0 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:10.199462 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b28d9a-36ea-4ee1-8b69-841f0b88f8e0 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:10.201006 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 523/1049] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 23:40:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:40:10.205962 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccfddda-9aff-4293-abd1-0496fa2c4424 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:10.206374 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccfddda-9aff-4293-abd1-0496fa2c4424 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:10.206523 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccfddda-9aff-4293-abd1-0496fa2c4424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:10.224053 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-7ccfddda-9aff-4293-abd1-0496fa2c4424 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:40:10.225278 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-7ccfddda-9aff-4293-abd1-0496fa2c4424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:40:10.233041 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 527/1050] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 23:40:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:40:10.391633 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b28d9a-36ea-4ee1-8b69-841f0b88f8e0 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:40:10.405044 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b28d9a-36ea-4ee1-8b69-841f0b88f8e0 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:40:10.409901 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e4435-e264-4513-82aa-78b19b6b1467 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e276c4bd434c028274e059a73c4060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:40:10.410530 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e4435-e264-4513-82aa-78b19b6b1467 service nova] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:10.410815 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e4435-e264-4513-82aa-78b19b6b1467 service nova] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:10.411090 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e4435-e264-4513-82aa-78b19b6b1467 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:10.419680 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e4435-e264-4513-82aa-78b19b6b1467 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:40:10.421299 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e4435-e264-4513-82aa-78b19b6b1467 service nova] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:40:10.431116 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 524/1051] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:40:10 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:40:11.239234 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19adc417-e557-47be-8335-3291938e6702 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:11.239817 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19adc417-e557-47be-8335-3291938e6702 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:11.239817 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19adc417-e557-47be-8335-3291938e6702 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:11.241903 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 528/1052] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 23:40:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:40:11.246943 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da77eb-2ec1-48f5-9285-ffcfa27d8311 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:11.247405 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da77eb-2ec1-48f5-9285-ffcfa27d8311 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:11.247512 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da77eb-2ec1-48f5-9285-ffcfa27d8311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:11.265420 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-f6da77eb-2ec1-48f5-9285-ffcfa27d8311 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:40:11.266605 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-f6da77eb-2ec1-48f5-9285-ffcfa27d8311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:40:11.274469 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 525/1053] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 23:40:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 23:40:11.429676 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19adc417-e557-47be-8335-3291938e6702 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:40:11.442715 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19adc417-e557-47be-8335-3291938e6702 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:40:11.448411 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f3c4f-ea34-4c42-9736-5079201e9641 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e276c4bd434c028274e059a73c4060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:40:11.449071 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f3c4f-ea34-4c42-9736-5079201e9641 service nova] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:11.449357 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f3c4f-ea34-4c42-9736-5079201e9641 service nova] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:11.449632 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f3c4f-ea34-4c42-9736-5079201e9641 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:11.457539 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f3c4f-ea34-4c42-9736-5079201e9641 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:40:11.459106 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f3c4f-ea34-4c42-9736-5079201e9641 service nova] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:40:11.468484 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 529/1054] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:40:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:40:12.278210 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdabcf-634c-421b-9b20-7c69c1c7f3f4 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:12.278780 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdabcf-634c-421b-9b20-7c69c1c7f3f4 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:12.278780 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdabcf-634c-421b-9b20-7c69c1c7f3f4 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:12.280108 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 526/1055] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 23:40:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:40:12.285094 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d3aa6-39de-47fa-8276-ae546f9f67d8 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:12.285487 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d3aa6-39de-47fa-8276-ae546f9f67d8 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:12.285652 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d3aa6-39de-47fa-8276-ae546f9f67d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:12.304815 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-e61d3aa6-39de-47fa-8276-ae546f9f67d8 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:40:12.306033 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-e61d3aa6-39de-47fa-8276-ae546f9f67d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:40:12.313756 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 530/1056] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 23:40:12 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:40:12.465556 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdabcf-634c-421b-9b20-7c69c1c7f3f4 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:40:12.481151 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdabcf-634c-421b-9b20-7c69c1c7f3f4 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:40:12.486416 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282785e-03fc-4269-abff-045281024a2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e276c4bd434c028274e059a73c4060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:40:12.487073 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282785e-03fc-4269-abff-045281024a2a service nova] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:12.487356 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282785e-03fc-4269-abff-045281024a2a service nova] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:12.487634 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282785e-03fc-4269-abff-045281024a2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:12.497411 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282785e-03fc-4269-abff-045281024a2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:40:12.499244 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282785e-03fc-4269-abff-045281024a2a service nova] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:40:12.510695 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 527/1057] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:40:12 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:40:14.879937 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0396f-f229-4521-8fb9-96b3874dcba1 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:14.880472 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0396f-f229-4521-8fb9-96b3874dcba1 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:14.880472 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0396f-f229-4521-8fb9-96b3874dcba1 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:14.882071 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 531/1058] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 23:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:40:14.887194 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3014c8-1807-47e6-befe-4168f6364670 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:14.887615 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3014c8-1807-47e6-befe-4168f6364670 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:14.887763 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3014c8-1807-47e6-befe-4168f6364670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:14.905523 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-2a3014c8-1807-47e6-befe-4168f6364670 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:40:14.906708 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-2a3014c8-1807-47e6-befe-4168f6364670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:40:14.915080 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 528/1059] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 23:40:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:40:14.954345 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0396f-f229-4521-8fb9-96b3874dcba1 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:40:14.964808 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0396f-f229-4521-8fb9-96b3874dcba1 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:40:14.968256 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c952087-905b-4205-810e-acd50cca731d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05f1ce71ea7c4301ae0bfc84a06c9c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:40:14.968917 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c952087-905b-4205-810e-acd50cca731d service neutron] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:14.969202 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c952087-905b-4205-810e-acd50cca731d service neutron] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:14.969476 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c952087-905b-4205-810e-acd50cca731d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:14.978643 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c952087-905b-4205-810e-acd50cca731d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:40:14.980055 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c952087-905b-4205-810e-acd50cca731d service neutron] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:40:14.989179 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 532/1060] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:40:14 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:40:17.379009 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782e541-b990-4c47-b37e-62460839064a None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:17.379589 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782e541-b990-4c47-b37e-62460839064a None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:17.379589 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782e541-b990-4c47-b37e-62460839064a None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:17.380986 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 529/1061] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 23:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:40:17.386676 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9513b73-9551-4a46-9802-14847e6ca5e8 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:17.387103 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9513b73-9551-4a46-9802-14847e6ca5e8 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:17.387221 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9513b73-9551-4a46-9802-14847e6ca5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:17.405100 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-f9513b73-9551-4a46-9802-14847e6ca5e8 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:40:17.406303 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-f9513b73-9551-4a46-9802-14847e6ca5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:40:17.414043 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 533/1062] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 23:40:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:40:17.452893 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782e541-b990-4c47-b37e-62460839064a None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:40:17.463771 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782e541-b990-4c47-b37e-62460839064a None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:40:17.467263 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575931de-8d80-47ef-b0e6-3ef9c2d25392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05f1ce71ea7c4301ae0bfc84a06c9c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:40:17.467893 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575931de-8d80-47ef-b0e6-3ef9c2d25392 service neutron] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:17.468181 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575931de-8d80-47ef-b0e6-3ef9c2d25392 service neutron] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:17.468462 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575931de-8d80-47ef-b0e6-3ef9c2d25392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:17.477377 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575931de-8d80-47ef-b0e6-3ef9c2d25392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:40:17.478800 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575931de-8d80-47ef-b0e6-3ef9c2d25392 service neutron] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:40:17.488066 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 530/1063] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:40:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:40:20.022564 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee60a8-6b44-486f-beae-9ac185cc5d61 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:20.023106 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee60a8-6b44-486f-beae-9ac185cc5d61 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:20.023106 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee60a8-6b44-486f-beae-9ac185cc5d61 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:20.024465 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 534/1064] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 23:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:40:20.029577 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4412bc-2df0-47dd-a7d4-133c0c3bc497 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:20.030015 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4412bc-2df0-47dd-a7d4-133c0c3bc497 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:20.030146 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4412bc-2df0-47dd-a7d4-133c0c3bc497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:20.047929 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-cb4412bc-2df0-47dd-a7d4-133c0c3bc497 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:40:20.049145 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-cb4412bc-2df0-47dd-a7d4-133c0c3bc497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:40:20.057664 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 531/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 23:40:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:40:20.096270 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee60a8-6b44-486f-beae-9ac185cc5d61 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:40:20.107326 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee60a8-6b44-486f-beae-9ac185cc5d61 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:40:20.111078 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d200ad28-443c-41a3-9ccd-fc81770fe6b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05f1ce71ea7c4301ae0bfc84a06c9c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:40:20.111736 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200ad28-443c-41a3-9ccd-fc81770fe6b3 service neutron] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:20.112009 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200ad28-443c-41a3-9ccd-fc81770fe6b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:20.112379 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200ad28-443c-41a3-9ccd-fc81770fe6b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:20.123383 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d200ad28-443c-41a3-9ccd-fc81770fe6b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:40:20.124960 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d200ad28-443c-41a3-9ccd-fc81770fe6b3 service neutron] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:40:20.134525 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 535/1066] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:40:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:40:22.496483 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ac301-bdf8-4dd4-ac82-a016f4397ea9 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:22.497060 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ac301-bdf8-4dd4-ac82-a016f4397ea9 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:22.497060 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ac301-bdf8-4dd4-ac82-a016f4397ea9 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:22.498397 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 532/1067] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 23:40:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:40:22.503627 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65e0d3-f72e-45a5-b539-87d590753527 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:22.504023 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65e0d3-f72e-45a5-b539-87d590753527 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:22.504184 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65e0d3-f72e-45a5-b539-87d590753527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:22.522015 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-5d65e0d3-f72e-45a5-b539-87d590753527 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:40:22.523371 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-5d65e0d3-f72e-45a5-b539-87d590753527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:40:22.531053 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 536/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 23:40:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:40:22.570754 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ac301-bdf8-4dd4-ac82-a016f4397ea9 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:40:22.581617 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ac301-bdf8-4dd4-ac82-a016f4397ea9 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:40:22.585225 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709da22-67ed-4784-b9bb-63315d7adc2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05f1ce71ea7c4301ae0bfc84a06c9c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:40:22.585851 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709da22-67ed-4784-b9bb-63315d7adc2f service neutron] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:22.586130 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709da22-67ed-4784-b9bb-63315d7adc2f service neutron] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:22.586403 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709da22-67ed-4784-b9bb-63315d7adc2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:22.595047 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5709da22-67ed-4784-b9bb-63315d7adc2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:40:22.596465 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5709da22-67ed-4784-b9bb-63315d7adc2f service neutron] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:40:22.606359 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 533/1069] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:40:22 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:40:24.874778 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba539c7-5a17-45fa-baa8-6c976436afbc None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:24.875315 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba539c7-5a17-45fa-baa8-6c976436afbc None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:24.875315 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba539c7-5a17-45fa-baa8-6c976436afbc None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:24.876603 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 537/1070] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 23:40:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:40:24.882525 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d3592-0bbd-49a5-bd3e-5c3651afdf78 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:24.882959 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d3592-0bbd-49a5-bd3e-5c3651afdf78 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:24.883064 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d3592-0bbd-49a5-bd3e-5c3651afdf78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:24.900669 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-a11d3592-0bbd-49a5-bd3e-5c3651afdf78 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:40:24.901882 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-a11d3592-0bbd-49a5-bd3e-5c3651afdf78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:40:24.909573 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 534/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 23:40:24 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:40:24.949945 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba539c7-5a17-45fa-baa8-6c976436afbc None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:40:24.960520 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba539c7-5a17-45fa-baa8-6c976436afbc None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:40:24.963998 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50ec17-dff6-40eb-b4d4-71b60aedbb67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05f1ce71ea7c4301ae0bfc84a06c9c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:40:24.964618 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50ec17-dff6-40eb-b4d4-71b60aedbb67 service neutron] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:24.964937 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50ec17-dff6-40eb-b4d4-71b60aedbb67 service neutron] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:24.965214 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50ec17-dff6-40eb-b4d4-71b60aedbb67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:24.973957 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50ec17-dff6-40eb-b4d4-71b60aedbb67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:40:24.975431 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50ec17-dff6-40eb-b4d4-71b60aedbb67 service neutron] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:40:24.984876 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 538/1072] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:40:24 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:40:27.344649 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee8217-a3bb-46b1-8845-62364df1eb7f None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:27.345234 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee8217-a3bb-46b1-8845-62364df1eb7f None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:27.345234 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee8217-a3bb-46b1-8845-62364df1eb7f None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:27.346579 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 535/1073] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 23:40:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:40:27.352585 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72d3c4-ac9d-4d62-bebd-2842baa6f530 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:27.353050 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72d3c4-ac9d-4d62-bebd-2842baa6f530 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:27.353185 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72d3c4-ac9d-4d62-bebd-2842baa6f530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:27.359054 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=70 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:40:27.371385 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-8d72d3c4-ac9d-4d62-bebd-2842baa6f530 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:40:27.372561 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-8d72d3c4-ac9d-4d62-bebd-2842baa6f530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:40:27.380423 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 539/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 23:40:27 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:40:27.420290 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee8217-a3bb-46b1-8845-62364df1eb7f None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:40:27.425718 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=64 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:40:27.432576 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee8217-a3bb-46b1-8845-62364df1eb7f None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:40:27.436063 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbcf5ee-4db0-4719-8eed-0732b35fdda2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05f1ce71ea7c4301ae0bfc84a06c9c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:40:27.436693 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcf5ee-4db0-4719-8eed-0732b35fdda2 service neutron] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:27.437020 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcf5ee-4db0-4719-8eed-0732b35fdda2 service neutron] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:27.437301 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcf5ee-4db0-4719-8eed-0732b35fdda2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:27.446720 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbcf5ee-4db0-4719-8eed-0732b35fdda2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:40:27.448158 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbcf5ee-4db0-4719-8eed-0732b35fdda2 service neutron] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:40:27.457457 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 536/1075] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:40:27 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:40:29.774185 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db5a01-5df1-4394-9411-65bb48cc49ca None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:29.774722 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db5a01-5df1-4394-9411-65bb48cc49ca None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:29.774722 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db5a01-5df1-4394-9411-65bb48cc49ca None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:29.776105 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 540/1076] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 23:40:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:40:29.781368 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0e5a2-69ef-4708-b1d6-4d8d91b6b6b1 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:29.781758 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0e5a2-69ef-4708-b1d6-4d8d91b6b6b1 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:29.781942 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0e5a2-69ef-4708-b1d6-4d8d91b6b6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:29.799737 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-eba0e5a2-69ef-4708-b1d6-4d8d91b6b6b1 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:40:29.800890 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-eba0e5a2-69ef-4708-b1d6-4d8d91b6b6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:40:29.809239 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 537/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 23:40:29 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:40:29.846389 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db5a01-5df1-4394-9411-65bb48cc49ca None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:40:29.857492 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db5a01-5df1-4394-9411-65bb48cc49ca None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:40:29.860938 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c10d59-8486-46bf-ac89-3165ec908d82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05f1ce71ea7c4301ae0bfc84a06c9c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:40:29.861562 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c10d59-8486-46bf-ac89-3165ec908d82 service neutron] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:29.861843 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c10d59-8486-46bf-ac89-3165ec908d82 service neutron] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:29.862117 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c10d59-8486-46bf-ac89-3165ec908d82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:29.871498 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c10d59-8486-46bf-ac89-3165ec908d82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:40:29.872955 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c10d59-8486-46bf-ac89-3165ec908d82 service neutron] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:40:29.882121 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 541/1078] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:40:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:40:32.147158 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42239cd-e86b-4c92-be54-7f8f2f2aaec8 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:32.147722 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42239cd-e86b-4c92-be54-7f8f2f2aaec8 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:32.147722 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42239cd-e86b-4c92-be54-7f8f2f2aaec8 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:32.149228 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 538/1079] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 23:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:40:32.154363 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199cfc1-0acc-4d01-88ac-c5c22ac9386f None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:32.154795 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199cfc1-0acc-4d01-88ac-c5c22ac9386f None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:32.154921 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199cfc1-0acc-4d01-88ac-c5c22ac9386f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:32.172540 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-3199cfc1-0acc-4d01-88ac-c5c22ac9386f None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:40:32.173742 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-3199cfc1-0acc-4d01-88ac-c5c22ac9386f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:40:32.181858 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 542/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 23:40:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:40:32.218662 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42239cd-e86b-4c92-be54-7f8f2f2aaec8 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:40:32.229939 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42239cd-e86b-4c92-be54-7f8f2f2aaec8 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:40:32.233409 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ffba3-8fe8-414a-9d9b-24ae81b6fcec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05f1ce71ea7c4301ae0bfc84a06c9c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:40:32.234035 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ffba3-8fe8-414a-9d9b-24ae81b6fcec service neutron] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:32.234322 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ffba3-8fe8-414a-9d9b-24ae81b6fcec service neutron] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:32.234599 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ffba3-8fe8-414a-9d9b-24ae81b6fcec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:32.244293 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ffba3-8fe8-414a-9d9b-24ae81b6fcec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:40:32.245747 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ffba3-8fe8-414a-9d9b-24ae81b6fcec service neutron] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:40:32.254935 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 539/1081] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:40:32 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:40:34.500633 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dceca98-d997-461e-aa8e-93f730682876 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:34.501213 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dceca98-d997-461e-aa8e-93f730682876 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:34.501213 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dceca98-d997-461e-aa8e-93f730682876 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:34.502585 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 543/1082] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 23:40:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:40:34.508335 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab74dd-fd51-4f7c-a7c4-f4cce7bce3a6 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:34.508767 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab74dd-fd51-4f7c-a7c4-f4cce7bce3a6 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:34.508922 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab74dd-fd51-4f7c-a7c4-f4cce7bce3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:34.527258 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-70ab74dd-fd51-4f7c-a7c4-f4cce7bce3a6 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:40:34.528438 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-70ab74dd-fd51-4f7c-a7c4-f4cce7bce3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:40:34.536076 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 540/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 23:40:34 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:40:34.573107 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dceca98-d997-461e-aa8e-93f730682876 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:40:34.584517 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dceca98-d997-461e-aa8e-93f730682876 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:40:34.588177 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd64fda-61a6-4f87-9ca1-49fc418f75cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05f1ce71ea7c4301ae0bfc84a06c9c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:40:34.588807 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd64fda-61a6-4f87-9ca1-49fc418f75cb service neutron] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:34.589114 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd64fda-61a6-4f87-9ca1-49fc418f75cb service neutron] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:34.589411 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd64fda-61a6-4f87-9ca1-49fc418f75cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:34.598287 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd64fda-61a6-4f87-9ca1-49fc418f75cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:40:34.599710 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd64fda-61a6-4f87-9ca1-49fc418f75cb service neutron] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:40:34.609039 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 544/1084] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:40:34 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:40:36.880923 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f359114-2be9-4484-a111-11a21962c930 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:36.881451 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f359114-2be9-4484-a111-11a21962c930 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:36.881451 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f359114-2be9-4484-a111-11a21962c930 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:36.882801 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 541/1085] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 23:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:40:36.888638 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b67f29-b72e-40a5-bd17-b8896f8ec91f None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:36.889136 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b67f29-b72e-40a5-bd17-b8896f8ec91f None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:36.889237 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b67f29-b72e-40a5-bd17-b8896f8ec91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:36.906922 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-22b67f29-b72e-40a5-bd17-b8896f8ec91f None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:40:36.908114 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-22b67f29-b72e-40a5-bd17-b8896f8ec91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:40:36.915871 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 545/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 23:40:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:40:36.953948 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f359114-2be9-4484-a111-11a21962c930 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:40:36.964341 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f359114-2be9-4484-a111-11a21962c930 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:40:36.967735 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fcb381-d39d-40a1-9450-9e2d695ed1e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05f1ce71ea7c4301ae0bfc84a06c9c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:40:36.968358 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fcb381-d39d-40a1-9450-9e2d695ed1e2 service neutron] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:40:36.968640 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fcb381-d39d-40a1-9450-9e2d695ed1e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:40:36.968941 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fcb381-d39d-40a1-9450-9e2d695ed1e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:40:36.977646 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fcb381-d39d-40a1-9450-9e2d695ed1e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:40:36.979068 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fcb381-d39d-40a1-9450-9e2d695ed1e2 service neutron] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:40:36.988139 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 542/1087] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:40:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:40:46.901895 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=20 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:40:46.984112 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=23 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:41:00.631409 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1514cb9-b144-4aef-97c8-3846927fba67 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:41:00.631970 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1514cb9-b144-4aef-97c8-3846927fba67 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:41:00.631970 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1514cb9-b144-4aef-97c8-3846927fba67 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:41:00.633380 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 546/1088] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:41:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:41:00.638543 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03eb88-ba2e-4aec-ad3b-e0e6b90bd953 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:41:00.638987 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03eb88-ba2e-4aec-ad3b-e0e6b90bd953 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:41:00.639087 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03eb88-ba2e-4aec-ad3b-e0e6b90bd953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:41:00.657217 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-2a03eb88-ba2e-4aec-ad3b-e0e6b90bd953 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:41:00.658398 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-2a03eb88-ba2e-4aec-ad3b-e0e6b90bd953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:41:00.665989 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 543/1089] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:41:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:41:00.714417 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f7692-4dc8-4f63-a2f9-2fde2b447876 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:41:00.714709 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f7692-4dc8-4f63-a2f9-2fde2b447876 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:41:00.714990 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f7692-4dc8-4f63-a2f9-2fde2b447876 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:41:00.716342 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 547/1090] 10.222.0.16 () {54 vars in 962 bytes} [Wed Jul 13 23:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:41:00.721455 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459a5e5-11d2-4934-84eb-48cd585dd561 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:41:00.721749 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459a5e5-11d2-4934-84eb-48cd585dd561 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:41:00.722033 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459a5e5-11d2-4934-84eb-48cd585dd561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:41:00.740144 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-f459a5e5-11d2-4934-84eb-48cd585dd561 None None] MFA Rules not processed for user `15cdeb3131bc419f98ab11aaa4562d19`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:41:00.741447 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-f459a5e5-11d2-4934-84eb-48cd585dd561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:41:00.747628 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 544/1091] 10.222.0.16 () {58 vars in 1059 bytes} [Wed Jul 13 23:41:00 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:41:00.754930 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f7692-4dc8-4f63-a2f9-2fde2b447876 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:41:00.766966 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f7692-4dc8-4f63-a2f9-2fde2b447876 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:41:00.770465 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e72b31-e6f7-458d-91f1-b0f6dd6af031 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cdeb3131bc419f98ab11aaa4562d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:41:00.771712 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e72b31-e6f7-458d-91f1-b0f6dd6af031 service glance] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:41:00.771998 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e72b31-e6f7-458d-91f1-b0f6dd6af031 service glance] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:41:00.772271 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e72b31-e6f7-458d-91f1-b0f6dd6af031 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:41:00.781076 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e72b31-e6f7-458d-91f1-b0f6dd6af031 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:41:00.782507 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e72b31-e6f7-458d-91f1-b0f6dd6af031 service glance] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:41:00.791760 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 548/1092] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:41:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 23:41:03.141119 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15420a0a-2e3b-43f9-96de-048e96477762 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:41:03.141688 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15420a0a-2e3b-43f9-96de-048e96477762 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:41:03.141688 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15420a0a-2e3b-43f9-96de-048e96477762 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:41:03.143050 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 545/1093] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:41:03.148890 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98943e-85fc-4f80-9a67-d46aa988468f None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:41:03.149336 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98943e-85fc-4f80-9a67-d46aa988468f None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:41:03.149472 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98943e-85fc-4f80-9a67-d46aa988468f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:41:03.167353 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-9c98943e-85fc-4f80-9a67-d46aa988468f None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:41:03.168528 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-9c98943e-85fc-4f80-9a67-d46aa988468f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:41:03.176066 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 549/1094] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:41:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:41:03.200035 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15420a0a-2e3b-43f9-96de-048e96477762 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:41:03.213633 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15420a0a-2e3b-43f9-96de-048e96477762 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:41:03.218027 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecebff13-11bb-4583-80cc-a6da1b0eedcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c258143da34685aa94a405e9ab3d07', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:41:03.218671 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebff13-11bb-4583-80cc-a6da1b0eedcf admin admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:41:03.218957 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebff13-11bb-4583-80cc-a6da1b0eedcf admin admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:41:03.219239 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebff13-11bb-4583-80cc-a6da1b0eedcf admin admin] PATH_INFO: `/v3/projects` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:41:03.219965 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecebff13-11bb-4583-80cc-a6da1b0eedcf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:41:03.221729 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: WARNING py.warnings [None req-ecebff13-11bb-4583-80cc-a6da1b0eedcf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 23:41:03.221729 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: warnings.warn(msg) Jul 13 23:41:03.221729 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: Jul 13 23:41:03.222870 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecebff13-11bb-4583-80cc-a6da1b0eedcf admin admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:41:03.242047 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 546/1095] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 13 23:41:03 2022] GET /identity/v3/projects => generated 1606 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 23:41:05.493900 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d5abc-f267-408f-84a3-869dcdc6af44 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:41:05.494434 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d5abc-f267-408f-84a3-869dcdc6af44 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:41:05.494434 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d5abc-f267-408f-84a3-869dcdc6af44 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:41:05.495799 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 550/1096] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:41:05.501032 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e10b2-c5ba-42c0-90c3-f6db9456e026 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:41:05.501408 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e10b2-c5ba-42c0-90c3-f6db9456e026 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:41:05.501604 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e10b2-c5ba-42c0-90c3-f6db9456e026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:41:05.520062 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-8f7e10b2-c5ba-42c0-90c3-f6db9456e026 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:41:05.521363 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-8f7e10b2-c5ba-42c0-90c3-f6db9456e026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:41:05.529213 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 547/1097] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:41:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:41:05.574340 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d5abc-f267-408f-84a3-869dcdc6af44 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:41:05.588030 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d5abc-f267-408f-84a3-869dcdc6af44 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:41:05.592963 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69777bb6-26ee-42fa-b2c7-31a83fec8884 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e276c4bd434c028274e059a73c4060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:41:05.593595 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69777bb6-26ee-42fa-b2c7-31a83fec8884 service nova] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:41:05.593885 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69777bb6-26ee-42fa-b2c7-31a83fec8884 service nova] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:41:05.594165 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69777bb6-26ee-42fa-b2c7-31a83fec8884 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:41:05.602303 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69777bb6-26ee-42fa-b2c7-31a83fec8884 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:41:05.603880 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69777bb6-26ee-42fa-b2c7-31a83fec8884 service nova] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:41:05.613102 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 551/1098] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:41:05 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:41:08.087626 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14790754-0747-4a12-a2a4-82c66a1dcfd0 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:41:08.088181 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14790754-0747-4a12-a2a4-82c66a1dcfd0 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:41:08.088181 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14790754-0747-4a12-a2a4-82c66a1dcfd0 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:41:08.089572 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 548/1099] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:41:08.094663 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2e63a-2c07-4fb8-8d87-305638b52108 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:41:08.095090 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2e63a-2c07-4fb8-8d87-305638b52108 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:41:08.095224 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2e63a-2c07-4fb8-8d87-305638b52108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:41:08.113680 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-57a2e63a-2c07-4fb8-8d87-305638b52108 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:41:08.115592 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-57a2e63a-2c07-4fb8-8d87-305638b52108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:41:08.123316 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 552/1100] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:41:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:41:08.159489 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14790754-0747-4a12-a2a4-82c66a1dcfd0 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:41:08.170839 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14790754-0747-4a12-a2a4-82c66a1dcfd0 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:41:08.174262 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ca3ac-7ef0-4fbc-9b3e-45a2deed4c5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05f1ce71ea7c4301ae0bfc84a06c9c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:41:08.174886 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ca3ac-7ef0-4fbc-9b3e-45a2deed4c5e service neutron] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:41:08.175169 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ca3ac-7ef0-4fbc-9b3e-45a2deed4c5e service neutron] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:41:08.175444 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ca3ac-7ef0-4fbc-9b3e-45a2deed4c5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:41:08.185092 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535ca3ac-7ef0-4fbc-9b3e-45a2deed4c5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:41:08.186520 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535ca3ac-7ef0-4fbc-9b3e-45a2deed4c5e service neutron] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:41:08.195719 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 549/1101] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:41:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:41:10.482426 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424b4d5-38a8-4c1e-bb02-86fec729a6dc None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:41:10.483018 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424b4d5-38a8-4c1e-bb02-86fec729a6dc None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:41:10.483018 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424b4d5-38a8-4c1e-bb02-86fec729a6dc None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:41:10.484361 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 553/1102] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:41:10.490226 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41e9dc-16f0-43a1-bc2f-39cd216863c3 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:41:10.490795 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41e9dc-16f0-43a1-bc2f-39cd216863c3 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:41:10.490795 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41e9dc-16f0-43a1-bc2f-39cd216863c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:41:10.508127 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-2f41e9dc-16f0-43a1-bc2f-39cd216863c3 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:41:10.509348 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-2f41e9dc-16f0-43a1-bc2f-39cd216863c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:41:10.517309 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 550/1103] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:41:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:41:10.556238 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424b4d5-38a8-4c1e-bb02-86fec729a6dc None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:41:10.566611 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424b4d5-38a8-4c1e-bb02-86fec729a6dc None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:41:10.570164 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36303368-d39f-44c3-8add-adb2604b6ce6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05f1ce71ea7c4301ae0bfc84a06c9c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:41:10.570782 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36303368-d39f-44c3-8add-adb2604b6ce6 service neutron] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:41:10.571063 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36303368-d39f-44c3-8add-adb2604b6ce6 service neutron] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:41:10.571334 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36303368-d39f-44c3-8add-adb2604b6ce6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:41:10.579895 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36303368-d39f-44c3-8add-adb2604b6ce6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:41:10.581351 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36303368-d39f-44c3-8add-adb2604b6ce6 service neutron] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:41:10.590395 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 554/1104] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:41:10 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:41:12.966852 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730521f8-ea17-4e6c-8dce-30270c8df0bf None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:41:12.967409 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730521f8-ea17-4e6c-8dce-30270c8df0bf None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:41:12.967409 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730521f8-ea17-4e6c-8dce-30270c8df0bf None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:41:12.968757 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 551/1105] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:41:12.973843 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e24d41-ba95-4383-85b4-b87eb544b13a None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:41:12.974236 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e24d41-ba95-4383-85b4-b87eb544b13a None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:41:12.974425 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e24d41-ba95-4383-85b4-b87eb544b13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:41:12.992035 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-93e24d41-ba95-4383-85b4-b87eb544b13a None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:41:12.993243 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-93e24d41-ba95-4383-85b4-b87eb544b13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:41:13.000788 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 555/1106] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:41:12 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:41:13.042186 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730521f8-ea17-4e6c-8dce-30270c8df0bf None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:41:13.053121 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730521f8-ea17-4e6c-8dce-30270c8df0bf None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:41:13.056544 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b828ee3-43b0-492c-a329-8df6d75cbae7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05f1ce71ea7c4301ae0bfc84a06c9c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:41:13.057200 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b828ee3-43b0-492c-a329-8df6d75cbae7 service neutron] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:41:13.057485 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b828ee3-43b0-492c-a329-8df6d75cbae7 service neutron] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:41:13.057759 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b828ee3-43b0-492c-a329-8df6d75cbae7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:41:13.066271 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b828ee3-43b0-492c-a329-8df6d75cbae7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:41:13.068352 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b828ee3-43b0-492c-a329-8df6d75cbae7 service neutron] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:41:13.078078 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 552/1107] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:41:13 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:41:15.486752 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fa27e-9f0a-4670-a3d4-b2195306396e None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:41:15.487296 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fa27e-9f0a-4670-a3d4-b2195306396e None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:41:15.487296 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fa27e-9f0a-4670-a3d4-b2195306396e None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:41:15.488801 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 556/1108] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 13 23:41:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:41:15.494063 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab2c03-fa29-4750-95e7-e86ac3c087a9 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:41:15.494503 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab2c03-fa29-4750-95e7-e86ac3c087a9 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:41:15.494634 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab2c03-fa29-4750-95e7-e86ac3c087a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:41:15.513039 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-4dab2c03-fa29-4750-95e7-e86ac3c087a9 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:41:15.514232 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-4dab2c03-fa29-4750-95e7-e86ac3c087a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:41:15.523944 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 553/1109] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 13 23:41:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:41:15.563909 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391fa27e-9f0a-4670-a3d4-b2195306396e None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:41:15.574952 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391fa27e-9f0a-4670-a3d4-b2195306396e None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:41:15.578382 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a73da6-f2a9-4a20-95f0-fa3c9555affc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05f1ce71ea7c4301ae0bfc84a06c9c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:41:15.579001 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a73da6-f2a9-4a20-95f0-fa3c9555affc service neutron] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:41:15.579282 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a73da6-f2a9-4a20-95f0-fa3c9555affc service neutron] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:41:15.579555 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a73da6-f2a9-4a20-95f0-fa3c9555affc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:41:15.589268 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a73da6-f2a9-4a20-95f0-fa3c9555affc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:41:15.590688 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a73da6-f2a9-4a20-95f0-fa3c9555affc service neutron] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:41:15.599926 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 557/1110] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:41:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:41:25.508124 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=33 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:41:25.595872 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=33 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:42:45.227389 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3842acd-db0a-4de9-88f7-c04411ba9a67 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:42:45.228006 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3842acd-db0a-4de9-88f7-c04411ba9a67 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:42:45.228006 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3842acd-db0a-4de9-88f7-c04411ba9a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:42:45.246575 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-c3842acd-db0a-4de9-88f7-c04411ba9a67 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:42:45.247774 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-c3842acd-db0a-4de9-88f7-c04411ba9a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:42:45.255607 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 554/1111] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 13 23:42:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:42:45.263515 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cc258-c6f8-410d-81de-3ad12bcccda3 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:42:45.264019 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cc258-c6f8-410d-81de-3ad12bcccda3 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:42:45.264132 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cc258-c6f8-410d-81de-3ad12bcccda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:42:45.282614 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-3c5cc258-c6f8-410d-81de-3ad12bcccda3 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:42:45.283803 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-3c5cc258-c6f8-410d-81de-3ad12bcccda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:42:45.292216 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 558/1112] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 13 23:42:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:42:45.296565 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3842acd-db0a-4de9-88f7-c04411ba9a67 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:42:45.306190 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3842acd-db0a-4de9-88f7-c04411ba9a67 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:42:45.310640 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a5294-4002-4415-a75c-9375f14d7974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c258143da34685aa94a405e9ab3d07', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:42:45.311280 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a5294-4002-4415-a75c-9375f14d7974 admin admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:42:45.311564 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a5294-4002-4415-a75c-9375f14d7974 admin admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:42:45.311839 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a5294-4002-4415-a75c-9375f14d7974 admin admin] PATH_INFO: `/v3/domains` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:42:45.312586 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a5294-4002-4415-a75c-9375f14d7974 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:42:45.312930 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a5294-4002-4415-a75c-9375f14d7974 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:42:45.313939 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: WARNING py.warnings [None req-c61a5294-4002-4415-a75c-9375f14d7974 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 23:42:45.313939 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: warnings.warn(msg) Jul 13 23:42:45.313939 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: Jul 13 23:42:45.314853 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a5294-4002-4415-a75c-9375f14d7974 admin admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:42:45.326686 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 555/1113] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 13 23:42:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:42:45.335412 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5cc258-c6f8-410d-81de-3ad12bcccda3 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:42:45.344337 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5cc258-c6f8-410d-81de-3ad12bcccda3 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:42:45.349618 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be346e1f-f0f4-4f21-b09d-4d398fb38868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c258143da34685aa94a405e9ab3d07', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:42:45.350257 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be346e1f-f0f4-4f21-b09d-4d398fb38868 admin admin] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:42:45.350541 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be346e1f-f0f4-4f21-b09d-4d398fb38868 admin admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:42:45.350817 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be346e1f-f0f4-4f21-b09d-4d398fb38868 admin admin] PATH_INFO: `/v3/projects` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:42:45.351496 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be346e1f-f0f4-4f21-b09d-4d398fb38868 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:42:45.353263 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: WARNING py.warnings [None req-be346e1f-f0f4-4f21-b09d-4d398fb38868 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 23:42:45.353263 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: warnings.warn(msg) Jul 13 23:42:45.353263 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: Jul 13 23:42:45.354452 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be346e1f-f0f4-4f21-b09d-4d398fb38868 admin admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:42:45.379768 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 559/1114] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 13 23:42:45 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 23:42:45.383837 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a5294-4002-4415-a75c-9375f14d7974 admin admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:42:45.394361 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a5294-4002-4415-a75c-9375f14d7974 admin admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:42:45.449410 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d5697-6358-4b4a-9506-e4032b9a0d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c258143da34685aa94a405e9ab3d07', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:42:45.450066 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d5697-6358-4b4a-9506-e4032b9a0d42 admin admin] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:42:45.450348 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d5697-6358-4b4a-9506-e4032b9a0d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:42:45.450622 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d5697-6358-4b4a-9506-e4032b9a0d42 admin admin] PATH_INFO: `/v3/users` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:42:45.451307 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d5697-6358-4b4a-9506-e4032b9a0d42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:42:45.452312 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: WARNING py.warnings [None req-f32d5697-6358-4b4a-9506-e4032b9a0d42 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 23:42:45.452312 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: warnings.warn(msg) Jul 13 23:42:45.452312 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: Jul 13 23:42:45.453539 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d5697-6358-4b4a-9506-e4032b9a0d42 admin admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:42:45.475349 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 556/1115] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 13 23:42:45 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 23:42:45.479511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be346e1f-f0f4-4f21-b09d-4d398fb38868 admin admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:42:45.489578 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be346e1f-f0f4-4f21-b09d-4d398fb38868 admin admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:42:45.494192 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f514a1-adfd-4a99-942e-3f35dfcdb825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c258143da34685aa94a405e9ab3d07', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:42:45.494851 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f514a1-adfd-4a99-942e-3f35dfcdb825 admin admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:42:45.495136 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f514a1-adfd-4a99-942e-3f35dfcdb825 admin admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:42:45.495412 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f514a1-adfd-4a99-942e-3f35dfcdb825 admin admin] PATH_INFO: `/v3/roles` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:42:45.496163 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f514a1-adfd-4a99-942e-3f35dfcdb825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:42:45.497248 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: WARNING py.warnings [None req-d9f514a1-adfd-4a99-942e-3f35dfcdb825 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 23:42:45.497248 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: warnings.warn(msg) Jul 13 23:42:45.497248 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: Jul 13 23:42:45.498133 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f514a1-adfd-4a99-942e-3f35dfcdb825 admin admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:42:45.512914 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 560/1116] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 13 23:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 23:42:45.516947 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d5697-6358-4b4a-9506-e4032b9a0d42 admin admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:42:45.528133 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d5697-6358-4b4a-9506-e4032b9a0d42 admin admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:42:45.532649 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f311db-5716-40c7-873f-d27df4551327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c258143da34685aa94a405e9ab3d07', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:42:45.533338 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f311db-5716-40c7-873f-d27df4551327 admin admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:42:45.533623 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f311db-5716-40c7-873f-d27df4551327 admin admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:42:45.533902 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f311db-5716-40c7-873f-d27df4551327 admin admin] PATH_INFO: `/v3/roles` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:42:45.534818 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f311db-5716-40c7-873f-d27df4551327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:42:45.535820 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: WARNING py.warnings [None req-d4f311db-5716-40c7-873f-d27df4551327 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 23:42:45.535820 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: warnings.warn(msg) Jul 13 23:42:45.535820 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: Jul 13 23:42:45.536701 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f311db-5716-40c7-873f-d27df4551327 admin admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:42:45.550241 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 557/1117] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 13 23:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 23:42:45.554529 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f514a1-adfd-4a99-942e-3f35dfcdb825 admin admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:42:45.564324 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f514a1-adfd-4a99-942e-3f35dfcdb825 admin admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:42:45.569793 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d14f0-a623-4a76-88c2-7d9ce52c9694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c258143da34685aa94a405e9ab3d07', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:42:45.570661 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d14f0-a623-4a76-88c2-7d9ce52c9694 admin admin] REQUEST_METHOD: `PUT` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:42:45.570940 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d14f0-a623-4a76-88c2-7d9ce52c9694 admin admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:42:45.571212 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d14f0-a623-4a76-88c2-7d9ce52c9694 admin admin] PATH_INFO: `/v3/projects/b889cad4b71c4a7fa0800249678170ea/users/3f9aaa6c71db4eadb2e03536d72be803/roles/69842edf01cf43eb814bb066f9652f48` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:42:45.586519 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5d14f0-a623-4a76-88c2-7d9ce52c9694 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b889cad4b71c4a7fa0800249678170ea, user_id=3f9aaa6c71db4eadb2e03536d72be803, role_id=69842edf01cf43eb814bb066f9652f48)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:42:45.587540 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: WARNING py.warnings [None req-5a5d14f0-a623-4a76-88c2-7d9ce52c9694 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 23:42:45.587540 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: warnings.warn(msg) Jul 13 23:42:45.587540 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: Jul 13 23:42:45.589527 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5d14f0-a623-4a76-88c2-7d9ce52c9694 admin admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:42:45.603301 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 561/1118] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 13 23:42:45 2022] PUT /identity/v3/projects/b889cad4b71c4a7fa0800249678170ea/users/3f9aaa6c71db4eadb2e03536d72be803/roles/69842edf01cf43eb814bb066f9652f48 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 23:42:45.615105 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d374d-7506-4fc1-bf4d-d3979797b405 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:42:45.615399 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d374d-7506-4fc1-bf4d-d3979797b405 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:42:45.615681 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d374d-7506-4fc1-bf4d-d3979797b405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:42:45.641857 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-445d374d-7506-4fc1-bf4d-d3979797b405 None None] MFA Rules not processed for user `3f9aaa6c71db4eadb2e03536d72be803`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:42:45.643052 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-445d374d-7506-4fc1-bf4d-d3979797b405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:42:45.704174 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 558/1119] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 13 23:42:45 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:42:45.718136 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd408367-0b7d-433f-8bd1-c0185ee56c87 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:42:45.718432 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd408367-0b7d-433f-8bd1-c0185ee56c87 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:42:45.718709 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd408367-0b7d-433f-8bd1-c0185ee56c87 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:42:45.720055 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 562/1120] 10.222.0.16 () {54 vars in 963 bytes} [Wed Jul 13 23:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:42:45.724905 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858af05-9c1b-4fe7-86bc-cbc231a88eec None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:42:45.725198 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858af05-9c1b-4fe7-86bc-cbc231a88eec None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:42:45.725480 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858af05-9c1b-4fe7-86bc-cbc231a88eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:42:45.743122 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-a858af05-9c1b-4fe7-86bc-cbc231a88eec None None] MFA Rules not processed for user `ce654da79295477792be5ddb6e60ff12`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:42:45.744243 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-a858af05-9c1b-4fe7-86bc-cbc231a88eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:42:45.788041 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:42:45.796244 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 559/1121] 10.222.0.16 () {58 vars in 1060 bytes} [Wed Jul 13 23:42:45 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:42:45.803635 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd408367-0b7d-433f-8bd1-c0185ee56c87 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:42:45.814144 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd408367-0b7d-433f-8bd1-c0185ee56c87 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:42:45.818207 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7c369-9aa9-4a96-b103-6bc41889ff65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce654da79295477792be5ddb6e60ff12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:42:45.818834 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7c369-9aa9-4a96-b103-6bc41889ff65 service cinder] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:42:45.819122 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7c369-9aa9-4a96-b103-6bc41889ff65 service cinder] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:42:45.819399 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7c369-9aa9-4a96-b103-6bc41889ff65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:42:45.827566 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e7c369-9aa9-4a96-b103-6bc41889ff65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:42:45.829018 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e7c369-9aa9-4a96-b103-6bc41889ff65 service cinder] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:42:45.838188 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 563/1122] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:42:45 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 23:42:45.872581 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358acf3e-f920-49ea-aeac-6cef29457ede None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:42:45.872985 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358acf3e-f920-49ea-aeac-6cef29457ede None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:42:45.873273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358acf3e-f920-49ea-aeac-6cef29457ede None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:42:45.874532 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 560/1123] 10.222.0.16 () {52 vars in 829 bytes} [Wed Jul 13 23:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:42:45.879262 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7c369-9aa9-4a96-b103-6bc41889ff65 service cinder] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:42:45.940002 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7c369-9aa9-4a96-b103-6bc41889ff65 service cinder] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:42:45.945348 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdfbda-b93b-4d92-ace9-1d17137b0b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c258143da34685aa94a405e9ab3d07', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:42:45.946201 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdfbda-b93b-4d92-ace9-1d17137b0b7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:42:45.946483 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdfbda-b93b-4d92-ace9-1d17137b0b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:42:45.946756 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdfbda-b93b-4d92-ace9-1d17137b0b7a admin admin] PATH_INFO: `/v3/users/3f9aaa6c71db4eadb2e03536d72be803` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:42:45.947937 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cdfbda-b93b-4d92-ace9-1d17137b0b7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f9aaa6c71db4eadb2e03536d72be803)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:42:45.948974 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: WARNING py.warnings [None req-e4cdfbda-b93b-4d92-ace9-1d17137b0b7a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 23:42:45.948974 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: warnings.warn(msg) Jul 13 23:42:45.948974 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: Jul 13 23:42:45.950180 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cdfbda-b93b-4d92-ace9-1d17137b0b7a admin admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:42:46.012551 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [None req-e4cdfbda-b93b-4d92-ace9-1d17137b0b7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f9aaa6c71db4eadb2e03536d72be803'} {{(pid=98935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:42:46.026724 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [None req-e4cdfbda-b93b-4d92-ace9-1d17137b0b7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f9aaa6c71db4eadb2e03536d72be803'} {{(pid=98935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:42:46.027834 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [None req-e4cdfbda-b93b-4d92-ace9-1d17137b0b7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f9aaa6c71db4eadb2e03536d72be803'} {{(pid=98935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:42:46.046778 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [None req-e4cdfbda-b93b-4d92-ace9-1d17137b0b7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f9aaa6c71db4eadb2e03536d72be803'} {{(pid=98935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:42:46.047520 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [None req-e4cdfbda-b93b-4d92-ace9-1d17137b0b7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f9aaa6c71db4eadb2e03536d72be803'} {{(pid=98935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:42:46.063028 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 564/1124] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 13 23:42:45 2022] DELETE /identity/v3/users/3f9aaa6c71db4eadb2e03536d72be803 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 23:42:46.068243 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48dfb8e-8991-4f3f-a585-ff00f94676d9 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:42:46.068528 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48dfb8e-8991-4f3f-a585-ff00f94676d9 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:42:46.068803 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48dfb8e-8991-4f3f-a585-ff00f94676d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:42:46.086146 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-a48dfb8e-8991-4f3f-a585-ff00f94676d9 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:42:46.087454 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-a48dfb8e-8991-4f3f-a585-ff00f94676d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:42:46.145951 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 561/1125] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 13 23:42:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:42:46.155499 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdfbda-b93b-4d92-ace9-1d17137b0b7a admin admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:42:46.156957 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-e4cdfbda-b93b-4d92-ace9-1d17137b0b7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:42:46.162422 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:42:46.216683 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdfbda-b93b-4d92-ace9-1d17137b0b7a admin admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:42:46.221753 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aca440-9f84-4489-846d-d328f4fd70c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05f1ce71ea7c4301ae0bfc84a06c9c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:42:46.222784 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aca440-9f84-4489-846d-d328f4fd70c9 service neutron] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:42:46.223103 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aca440-9f84-4489-846d-d328f4fd70c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:42:46.223364 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aca440-9f84-4489-846d-d328f4fd70c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:42:46.234895 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aca440-9f84-4489-846d-d328f4fd70c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:42:46.236357 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aca440-9f84-4489-846d-d328f4fd70c9 service neutron] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:42:46.246274 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 565/1126] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:42:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:42:46.666982 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48dfb8e-8991-4f3f-a585-ff00f94676d9 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:42:46.668500 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-a48dfb8e-8991-4f3f-a585-ff00f94676d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:42:46.680891 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48dfb8e-8991-4f3f-a585-ff00f94676d9 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:42:46.685379 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4094096-c9e2-410f-842a-84c35a06cb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c258143da34685aa94a405e9ab3d07', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:42:46.686235 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4094096-c9e2-410f-842a-84c35a06cb46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:42:46.686521 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4094096-c9e2-410f-842a-84c35a06cb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:42:46.686796 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4094096-c9e2-410f-842a-84c35a06cb46 admin admin] PATH_INFO: `/v3/projects/b889cad4b71c4a7fa0800249678170ea` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:42:46.687972 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4094096-c9e2-410f-842a-84c35a06cb46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b889cad4b71c4a7fa0800249678170ea)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:42:46.689018 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: WARNING py.warnings [None req-f4094096-c9e2-410f-842a-84c35a06cb46 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 23:42:46.689018 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: warnings.warn(msg) Jul 13 23:42:46.689018 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: Jul 13 23:42:46.690221 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4094096-c9e2-410f-842a-84c35a06cb46 admin admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:42:46.757594 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [None req-f4094096-c9e2-410f-842a-84c35a06cb46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b889cad4b71c4a7fa0800249678170ea', 'request_id': 'req-f4094096-c9e2-410f-842a-84c35a06cb46'} {{(pid=98936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:42:46.772302 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [None req-f4094096-c9e2-410f-842a-84c35a06cb46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b889cad4b71c4a7fa0800249678170ea', 'request_id': 'req-f4094096-c9e2-410f-842a-84c35a06cb46'} {{(pid=98936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:42:46.778337 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [None req-f4094096-c9e2-410f-842a-84c35a06cb46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b889cad4b71c4a7fa0800249678170ea', 'request_id': 'req-f4094096-c9e2-410f-842a-84c35a06cb46'} {{(pid=98936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:42:46.792836 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [None req-f4094096-c9e2-410f-842a-84c35a06cb46 admin admin] The token cache is being invalidate because project b889cad4b71c4a7fa0800249678170ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 23:42:46.793136 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [None req-f4094096-c9e2-410f-842a-84c35a06cb46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:42:46.793829 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [None req-f4094096-c9e2-410f-842a-84c35a06cb46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:42:46.795352 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 562/1127] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 13 23:42:46 2022] DELETE /identity/v3/projects/b889cad4b71c4a7fa0800249678170ea => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 23:42:56.242207 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=25 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:42:56.789865 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:44:09.831306 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054f8aa-cadd-4e1d-a8ad-96d39c095263 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:44:09.831818 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054f8aa-cadd-4e1d-a8ad-96d39c095263 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:44:09.831818 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054f8aa-cadd-4e1d-a8ad-96d39c095263 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:44:09.833344 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 566/1128] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 23:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:44:09.837923 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8fd75-82d3-4b0d-bd36-e3bd068fc279 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:44:09.838333 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8fd75-82d3-4b0d-bd36-e3bd068fc279 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:44:09.838483 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8fd75-82d3-4b0d-bd36-e3bd068fc279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:44:09.904467 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-75d8fd75-82d3-4b0d-bd36-e3bd068fc279 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:44:09.905824 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-75d8fd75-82d3-4b0d-bd36-e3bd068fc279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:44:09.996409 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 563/1129] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 23:44:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:44:10.156990 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054f8aa-cadd-4e1d-a8ad-96d39c095263 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:44:10.158673 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-7054f8aa-cadd-4e1d-a8ad-96d39c095263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:44:10.244630 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054f8aa-cadd-4e1d-a8ad-96d39c095263 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:44:10.249551 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80fa9f0-e35b-4c2e-80b3-7558d4779c00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e276c4bd434c028274e059a73c4060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:44:10.250196 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fa9f0-e35b-4c2e-80b3-7558d4779c00 service nova] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:44:10.250482 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fa9f0-e35b-4c2e-80b3-7558d4779c00 service nova] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:44:10.250761 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fa9f0-e35b-4c2e-80b3-7558d4779c00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:44:10.258850 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80fa9f0-e35b-4c2e-80b3-7558d4779c00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:44:10.260451 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80fa9f0-e35b-4c2e-80b3-7558d4779c00 service nova] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:44:10.270493 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 567/1130] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:44:10 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:44:11.130314 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e04bc-ef35-4a89-b438-4eec69dcf975 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:44:11.130840 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e04bc-ef35-4a89-b438-4eec69dcf975 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:44:11.130840 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e04bc-ef35-4a89-b438-4eec69dcf975 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:44:11.132152 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 564/1131] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 23:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:44:11.137787 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a7da9-6b7b-4a53-8553-0b631890809c None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:44:11.138195 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a7da9-6b7b-4a53-8553-0b631890809c None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:44:11.138346 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a7da9-6b7b-4a53-8553-0b631890809c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:44:11.156266 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-1a5a7da9-6b7b-4a53-8553-0b631890809c None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:44:11.157493 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-1a5a7da9-6b7b-4a53-8553-0b631890809c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:44:11.165127 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 568/1132] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 23:44:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:44:11.330353 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e04bc-ef35-4a89-b438-4eec69dcf975 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:44:11.344120 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e04bc-ef35-4a89-b438-4eec69dcf975 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:44:11.348918 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c117d87-4f98-4843-9b32-5bb958515bd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e276c4bd434c028274e059a73c4060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:44:11.349547 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c117d87-4f98-4843-9b32-5bb958515bd3 service nova] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:44:11.349830 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c117d87-4f98-4843-9b32-5bb958515bd3 service nova] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:44:11.350106 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c117d87-4f98-4843-9b32-5bb958515bd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:44:11.358099 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c117d87-4f98-4843-9b32-5bb958515bd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:44:11.359685 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c117d87-4f98-4843-9b32-5bb958515bd3 service nova] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:44:11.368732 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 565/1133] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:44:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:44:15.877669 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d539c2-1dc1-40b0-abc1-93f3f2ebf980 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:44:15.878217 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d539c2-1dc1-40b0-abc1-93f3f2ebf980 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:44:15.878217 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d539c2-1dc1-40b0-abc1-93f3f2ebf980 None None] PATH_INFO: `/v3` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:44:15.879473 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 569/1134] 10.222.0.65 () {54 vars in 925 bytes} [Wed Jul 13 23:44:15 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:44:15.896932 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3f063-dd85-41d6-ace1-47019118512e None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:44:15.897376 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3f063-dd85-41d6-ace1-47019118512e None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:44:15.897479 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3f063-dd85-41d6-ace1-47019118512e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:44:15.927134 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-2dd3f063-dd85-41d6-ace1-47019118512e None None] MFA Rules not processed for user `4fbb147d802e48a082c7d928714f1dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:44:15.928340 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-2dd3f063-dd85-41d6-ace1-47019118512e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:44:15.979610 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:44:15.989985 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 566/1135] 10.222.0.65 () {58 vars in 1015 bytes} [Wed Jul 13 23:44:15 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:44:21.151517 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=42 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:44:22.611866 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebda9f7-190d-472d-8e2a-c4209de2d87d None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:44:22.612531 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebda9f7-190d-472d-8e2a-c4209de2d87d None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:44:22.612531 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebda9f7-190d-472d-8e2a-c4209de2d87d None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:44:22.613881 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 570/1136] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 23:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:44:22.618547 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7da288-3d1e-4005-9fa2-3420c6ce16ad None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:44:22.618944 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7da288-3d1e-4005-9fa2-3420c6ce16ad None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:44:22.619105 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7da288-3d1e-4005-9fa2-3420c6ce16ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:44:22.638040 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-bc7da288-3d1e-4005-9fa2-3420c6ce16ad None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:44:22.639236 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-bc7da288-3d1e-4005-9fa2-3420c6ce16ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:44:22.647200 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 567/1137] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 23:44:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:44:22.806062 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebda9f7-190d-472d-8e2a-c4209de2d87d None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:44:22.821664 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebda9f7-190d-472d-8e2a-c4209de2d87d None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:44:22.826807 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c5eb1-eb04-4282-880a-a6037740e5f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e276c4bd434c028274e059a73c4060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:44:22.827439 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c5eb1-eb04-4282-880a-a6037740e5f3 service nova] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:44:22.827724 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c5eb1-eb04-4282-880a-a6037740e5f3 service nova] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:44:22.828001 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c5eb1-eb04-4282-880a-a6037740e5f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:44:22.836150 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c5eb1-eb04-4282-880a-a6037740e5f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:44:22.837769 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c5eb1-eb04-4282-880a-a6037740e5f3 service nova] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:44:22.847011 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 571/1138] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:44:22 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:44:23.670178 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc39859-fbcd-4ba9-8474-d644ace4a2e0 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:44:23.670728 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc39859-fbcd-4ba9-8474-d644ace4a2e0 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:44:23.670728 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc39859-fbcd-4ba9-8474-d644ace4a2e0 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:44:23.672081 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 568/1139] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 23:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:44:23.676836 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b986114-18e6-4220-bd60-5aa51df41b3e None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:44:23.677241 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b986114-18e6-4220-bd60-5aa51df41b3e None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:44:23.677413 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b986114-18e6-4220-bd60-5aa51df41b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:44:23.695505 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-1b986114-18e6-4220-bd60-5aa51df41b3e None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:44:23.696686 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-1b986114-18e6-4220-bd60-5aa51df41b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:44:23.704508 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 572/1140] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 23:44:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:44:23.865360 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc39859-fbcd-4ba9-8474-d644ace4a2e0 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:44:23.879107 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc39859-fbcd-4ba9-8474-d644ace4a2e0 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:44:23.883914 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22abbc52-b9f3-47fb-944f-477771c658dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e276c4bd434c028274e059a73c4060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:44:23.884565 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abbc52-b9f3-47fb-944f-477771c658dc service nova] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:44:23.884847 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abbc52-b9f3-47fb-944f-477771c658dc service nova] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:44:23.885150 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abbc52-b9f3-47fb-944f-477771c658dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:44:23.894659 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22abbc52-b9f3-47fb-944f-477771c658dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:44:23.896301 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22abbc52-b9f3-47fb-944f-477771c658dc service nova] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:44:23.906626 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 569/1141] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:44:23 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:44:25.918741 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebb488-24ba-4576-85bd-575aa58363bf None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:44:25.919358 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebb488-24ba-4576-85bd-575aa58363bf None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:44:25.919358 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebb488-24ba-4576-85bd-575aa58363bf None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:44:25.920601 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 573/1142] 10.222.0.16 () {54 vars in 960 bytes} [Wed Jul 13 23:44:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:44:25.925441 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57955088-4998-458e-922e-7b3ec376f395 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:44:25.925872 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57955088-4998-458e-922e-7b3ec376f395 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:44:25.925983 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57955088-4998-458e-922e-7b3ec376f395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:44:25.943876 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-57955088-4998-458e-922e-7b3ec376f395 None None] MFA Rules not processed for user `4fbb147d802e48a082c7d928714f1dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:44:25.945136 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-57955088-4998-458e-922e-7b3ec376f395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:44:25.953936 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 570/1143] 10.222.0.16 () {58 vars in 1057 bytes} [Wed Jul 13 23:44:25 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:44:25.961442 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aebb488-24ba-4576-85bd-575aa58363bf None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:44:25.974607 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aebb488-24ba-4576-85bd-575aa58363bf None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:44:25.979434 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbdb58-19f9-46fe-9549-347296943247 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fbb147d802e48a082c7d928714f1dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:44:25.980054 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbdb58-19f9-46fe-9549-347296943247 service placement] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:44:25.980862 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbdb58-19f9-46fe-9549-347296943247 service placement] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:44:25.981139 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbdb58-19f9-46fe-9549-347296943247 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:44:25.989132 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fbdb58-19f9-46fe-9549-347296943247 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:44:25.990712 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fbdb58-19f9-46fe-9549-347296943247 service placement] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:44:26.000652 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 574/1144] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:44:25 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 23:44:35.163117 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3eb38f-0d57-4ec1-869c-96457be50fd9 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:44:35.163708 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3eb38f-0d57-4ec1-869c-96457be50fd9 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:44:35.163708 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3eb38f-0d57-4ec1-869c-96457be50fd9 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:44:35.165056 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 571/1145] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 23:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:44:35.171979 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa4515-b058-449e-931c-9acfeba44a41 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:44:35.173427 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa4515-b058-449e-931c-9acfeba44a41 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:44:35.173427 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa4515-b058-449e-931c-9acfeba44a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:44:35.193541 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-90fa4515-b058-449e-931c-9acfeba44a41 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:44:35.194739 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-90fa4515-b058-449e-931c-9acfeba44a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:44:35.203222 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 575/1146] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 23:44:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:44:35.359421 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3eb38f-0d57-4ec1-869c-96457be50fd9 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:44:35.374222 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3eb38f-0d57-4ec1-869c-96457be50fd9 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:44:35.381247 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f660e5c-34a0-4436-9663-c6783bd9ec04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e276c4bd434c028274e059a73c4060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:44:35.381889 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f660e5c-34a0-4436-9663-c6783bd9ec04 service nova] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:44:35.382178 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f660e5c-34a0-4436-9663-c6783bd9ec04 service nova] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:44:35.382452 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f660e5c-34a0-4436-9663-c6783bd9ec04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:44:35.391821 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f660e5c-34a0-4436-9663-c6783bd9ec04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:44:35.394678 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f660e5c-34a0-4436-9663-c6783bd9ec04 service nova] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:44:35.404097 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 572/1147] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:44:35 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:44:36.219214 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bafd5b-f66f-4326-922c-28135d30b8ec None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:44:36.219775 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bafd5b-f66f-4326-922c-28135d30b8ec None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:44:36.219775 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bafd5b-f66f-4326-922c-28135d30b8ec None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:44:36.221193 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 576/1148] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 23:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:44:36.226074 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a4168-4b6f-4e7f-8d99-496c495eacf9 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:44:36.226490 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a4168-4b6f-4e7f-8d99-496c495eacf9 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:44:36.226634 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a4168-4b6f-4e7f-8d99-496c495eacf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:44:36.246480 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-cd7a4168-4b6f-4e7f-8d99-496c495eacf9 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:44:36.247671 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-cd7a4168-4b6f-4e7f-8d99-496c495eacf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:44:36.255456 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 573/1149] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 23:44:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:44:36.411545 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bafd5b-f66f-4326-922c-28135d30b8ec None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:44:36.424732 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bafd5b-f66f-4326-922c-28135d30b8ec None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:44:36.429544 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f3063-9fce-4c47-a730-32d8add49245 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e276c4bd434c028274e059a73c4060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:44:36.430170 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f3063-9fce-4c47-a730-32d8add49245 service nova] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:44:36.430454 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f3063-9fce-4c47-a730-32d8add49245 service nova] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:44:36.430728 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f3063-9fce-4c47-a730-32d8add49245 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:44:36.438622 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f3063-9fce-4c47-a730-32d8add49245 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:44:36.440213 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f3063-9fce-4c47-a730-32d8add49245 service nova] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:44:36.450121 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 577/1150] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:44:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:44:40.602952 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8cc07-9c5a-41e7-8641-7a6d17b8d191 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:44:40.603503 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8cc07-9c5a-41e7-8641-7a6d17b8d191 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:44:40.603503 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8cc07-9c5a-41e7-8641-7a6d17b8d191 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:44:40.605652 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 574/1151] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 23:44:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:44:40.610809 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427b5ef-67b6-4485-bb81-ef37abf792fd None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:44:40.611276 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427b5ef-67b6-4485-bb81-ef37abf792fd None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:44:40.611386 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427b5ef-67b6-4485-bb81-ef37abf792fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:44:40.629348 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-0427b5ef-67b6-4485-bb81-ef37abf792fd None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:44:40.630544 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-0427b5ef-67b6-4485-bb81-ef37abf792fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:44:40.638822 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 578/1152] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 23:44:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:44:40.675184 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8cc07-9c5a-41e7-8641-7a6d17b8d191 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:44:40.676878 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-48d8cc07-9c5a-41e7-8641-7a6d17b8d191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:44:40.733382 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8cc07-9c5a-41e7-8641-7a6d17b8d191 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:44:40.736875 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d655541-346d-4230-823b-e576bc2d641e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05f1ce71ea7c4301ae0bfc84a06c9c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:44:40.737517 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d655541-346d-4230-823b-e576bc2d641e service neutron] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:44:40.737803 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d655541-346d-4230-823b-e576bc2d641e service neutron] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:44:40.738081 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d655541-346d-4230-823b-e576bc2d641e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:44:40.746930 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d655541-346d-4230-823b-e576bc2d641e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:44:40.748353 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d655541-346d-4230-823b-e576bc2d641e service neutron] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:44:40.757475 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 575/1153] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:44:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:44:43.025026 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ab6c4-9a2e-4d14-b14d-b67582b18b42 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:44:43.025570 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ab6c4-9a2e-4d14-b14d-b67582b18b42 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:44:43.025570 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ab6c4-9a2e-4d14-b14d-b67582b18b42 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:44:43.027640 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 579/1154] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 23:44:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:44:43.032792 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4994906-1c1e-40a4-815e-1e9bf123d7ca None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:44:43.033253 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4994906-1c1e-40a4-815e-1e9bf123d7ca None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:44:43.033372 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4994906-1c1e-40a4-815e-1e9bf123d7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:44:43.051123 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-c4994906-1c1e-40a4-815e-1e9bf123d7ca None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:44:43.052314 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-c4994906-1c1e-40a4-815e-1e9bf123d7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:44:43.060071 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 576/1155] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 23:44:43 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:44:43.099239 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ab6c4-9a2e-4d14-b14d-b67582b18b42 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:44:43.101461 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-8c7ab6c4-9a2e-4d14-b14d-b67582b18b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:44:43.115138 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ab6c4-9a2e-4d14-b14d-b67582b18b42 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:44:43.118647 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b5da3-1242-4804-a35f-7dc6aebdae5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05f1ce71ea7c4301ae0bfc84a06c9c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:44:43.119279 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b5da3-1242-4804-a35f-7dc6aebdae5e service neutron] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:44:43.119563 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b5da3-1242-4804-a35f-7dc6aebdae5e service neutron] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:44:43.119840 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b5da3-1242-4804-a35f-7dc6aebdae5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:44:43.128700 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b5da3-1242-4804-a35f-7dc6aebdae5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:44:43.130162 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b5da3-1242-4804-a35f-7dc6aebdae5e service neutron] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:44:43.139983 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 580/1156] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:44:43 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 23:44:46.891389 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c583c90-d693-4e40-98e7-439c1ce8d230 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:44:46.891949 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c583c90-d693-4e40-98e7-439c1ce8d230 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:44:46.891949 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c583c90-d693-4e40-98e7-439c1ce8d230 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:44:46.893320 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 577/1157] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 23:44:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:44:46.898614 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfca9c-b9b3-4752-88bf-e63a491e9b47 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:44:46.899051 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfca9c-b9b3-4752-88bf-e63a491e9b47 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:44:46.899161 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfca9c-b9b3-4752-88bf-e63a491e9b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:44:46.917814 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-31bfca9c-b9b3-4752-88bf-e63a491e9b47 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:44:46.919022 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-31bfca9c-b9b3-4752-88bf-e63a491e9b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:44:46.926674 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 581/1158] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 23:44:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:44:47.202089 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c583c90-d693-4e40-98e7-439c1ce8d230 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:44:47.203813 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-2c583c90-d693-4e40-98e7-439c1ce8d230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:44:47.209535 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=51 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:44:47.263449 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c583c90-d693-4e40-98e7-439c1ce8d230 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:44:47.267209 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589cad1-bcc4-4b6e-a6d8-93272e01d8a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce654da79295477792be5ddb6e60ff12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:44:47.267858 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589cad1-bcc4-4b6e-a6d8-93272e01d8a6 service cinder] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:44:47.268141 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589cad1-bcc4-4b6e-a6d8-93272e01d8a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:44:47.268416 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589cad1-bcc4-4b6e-a6d8-93272e01d8a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:44:47.277620 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7589cad1-bcc4-4b6e-a6d8-93272e01d8a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:44:47.279044 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7589cad1-bcc4-4b6e-a6d8-93272e01d8a6 service cinder] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:44:47.288748 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 578/1159] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:44:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:44:49.553434 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5eaaa-56cf-478f-abd1-8125f2d256ac None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:44:49.553859 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5eaaa-56cf-478f-abd1-8125f2d256ac None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:44:49.553998 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5eaaa-56cf-478f-abd1-8125f2d256ac None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:44:49.555364 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 582/1160] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 23:44:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:44:49.560655 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3ce27-fb5a-4d65-9829-33876df37f97 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:44:49.561076 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3ce27-fb5a-4d65-9829-33876df37f97 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:44:49.561255 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3ce27-fb5a-4d65-9829-33876df37f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:44:49.578859 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-c2b3ce27-fb5a-4d65-9829-33876df37f97 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:44:49.580335 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-c2b3ce27-fb5a-4d65-9829-33876df37f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:44:49.588434 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 579/1161] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 23:44:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:44:49.857615 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5eaaa-56cf-478f-abd1-8125f2d256ac None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:44:49.859281 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-eff5eaaa-56cf-478f-abd1-8125f2d256ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:44:49.871931 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5eaaa-56cf-478f-abd1-8125f2d256ac None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:44:49.875366 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab342fd-3b61-4e41-85f6-81fd0760a12b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce654da79295477792be5ddb6e60ff12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:44:49.875990 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab342fd-3b61-4e41-85f6-81fd0760a12b service cinder] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:44:49.876273 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab342fd-3b61-4e41-85f6-81fd0760a12b service cinder] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:44:49.876546 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab342fd-3b61-4e41-85f6-81fd0760a12b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:44:49.885583 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab342fd-3b61-4e41-85f6-81fd0760a12b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:44:49.887609 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab342fd-3b61-4e41-85f6-81fd0760a12b service cinder] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:44:49.897126 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 583/1162] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:44:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:44:59.573735 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=28 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:44:59.893052 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=42 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:46:10.626906 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb4e0c-c0dc-4396-a7a4-fab6dbf3ecf3 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:10.627536 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e56bd-7b56-4bd5-a17e-0eda15775e1e None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:10.627948 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb4e0c-c0dc-4396-a7a4-fab6dbf3ecf3 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:10.628055 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e56bd-7b56-4bd5-a17e-0eda15775e1e None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:10.628155 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb4e0c-c0dc-4396-a7a4-fab6dbf3ecf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:10.628259 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e56bd-7b56-4bd5-a17e-0eda15775e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:10.646152 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-67cb4e0c-c0dc-4396-a7a4-fab6dbf3ecf3 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:46:10.646384 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-1e4e56bd-7b56-4bd5-a17e-0eda15775e1e None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:46:10.647369 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-67cb4e0c-c0dc-4396-a7a4-fab6dbf3ecf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:46:10.647490 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-1e4e56bd-7b56-4bd5-a17e-0eda15775e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:46:10.655427 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 584/1163] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 13 23:46:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 23:46:10.655590 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 580/1164] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 13 23:46:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:46:10.663374 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa061ac-3d5f-4bfa-9919-bab2e0291a07 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:10.663520 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699894cb-d4c2-4ab9-a241-9e3b2e62d591 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:10.663660 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699894cb-d4c2-4ab9-a241-9e3b2e62d591 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:10.663782 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa061ac-3d5f-4bfa-9919-bab2e0291a07 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:10.663936 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa061ac-3d5f-4bfa-9919-bab2e0291a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:10.664050 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699894cb-d4c2-4ab9-a241-9e3b2e62d591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:10.682173 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-699894cb-d4c2-4ab9-a241-9e3b2e62d591 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:46:10.682374 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-daa061ac-3d5f-4bfa-9919-bab2e0291a07 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:46:10.683346 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-699894cb-d4c2-4ab9-a241-9e3b2e62d591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:46:10.683552 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-daa061ac-3d5f-4bfa-9919-bab2e0291a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:46:10.691867 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 585/1165] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 13 23:46:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 23:46:10.692286 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 581/1166] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 13 23:46:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 23:46:10.696365 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699894cb-d4c2-4ab9-a241-9e3b2e62d591 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:46:10.696514 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa061ac-3d5f-4bfa-9919-bab2e0291a07 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:46:10.705332 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa061ac-3d5f-4bfa-9919-bab2e0291a07 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:46:10.705490 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699894cb-d4c2-4ab9-a241-9e3b2e62d591 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:46:10.709806 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6027a2-67dd-4cb6-898d-aa9a2c9c2aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c258143da34685aa94a405e9ab3d07', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:46:10.709963 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f4365-cb48-439c-8dd1-0e44839bb9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c258143da34685aa94a405e9ab3d07', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:46:10.710441 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6027a2-67dd-4cb6-898d-aa9a2c9c2aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:10.710571 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f4365-cb48-439c-8dd1-0e44839bb9cd admin admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:10.710724 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6027a2-67dd-4cb6-898d-aa9a2c9c2aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:10.710830 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f4365-cb48-439c-8dd1-0e44839bb9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:10.711012 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6027a2-67dd-4cb6-898d-aa9a2c9c2aa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:10.711119 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f4365-cb48-439c-8dd1-0e44839bb9cd admin admin] PATH_INFO: `/v3/domains` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:10.711724 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802f4365-cb48-439c-8dd1-0e44839bb9cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:46:10.711861 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6027a2-67dd-4cb6-898d-aa9a2c9c2aa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 23:46:10.712028 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802f4365-cb48-439c-8dd1-0e44839bb9cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:46:10.712138 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6027a2-67dd-4cb6-898d-aa9a2c9c2aa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:46:10.713071 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: WARNING py.warnings [None req-802f4365-cb48-439c-8dd1-0e44839bb9cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 23:46:10.713071 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: warnings.warn(msg) Jul 13 23:46:10.713071 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: Jul 13 23:46:10.713652 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6027a2-67dd-4cb6-898d-aa9a2c9c2aa2 admin admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:46:10.713944 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802f4365-cb48-439c-8dd1-0e44839bb9cd admin admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:46:10.725600 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 586/1167] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 13 23:46:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:46:10.725746 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 582/1168] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 13 23:46:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 23:46:10.734005 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f4365-cb48-439c-8dd1-0e44839bb9cd admin admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:46:10.734162 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6027a2-67dd-4cb6-898d-aa9a2c9c2aa2 admin admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:46:10.743800 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6027a2-67dd-4cb6-898d-aa9a2c9c2aa2 admin admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:46:10.743934 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f4365-cb48-439c-8dd1-0e44839bb9cd admin admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:46:10.749014 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e4d12-1045-49af-95b8-2c9a48b5c8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c258143da34685aa94a405e9ab3d07', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:46:10.749170 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195051ab-5126-4f3e-8c34-339f1fe2908f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c258143da34685aa94a405e9ab3d07', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:46:10.749651 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e4d12-1045-49af-95b8-2c9a48b5c8a7 admin admin] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:10.749751 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195051ab-5126-4f3e-8c34-339f1fe2908f admin admin] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:10.749938 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e4d12-1045-49af-95b8-2c9a48b5c8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:10.750043 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195051ab-5126-4f3e-8c34-339f1fe2908f admin admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:10.750213 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e4d12-1045-49af-95b8-2c9a48b5c8a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:10.750322 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195051ab-5126-4f3e-8c34-339f1fe2908f admin admin] PATH_INFO: `/v3/projects` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:10.750902 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e4d12-1045-49af-95b8-2c9a48b5c8a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:46:10.751006 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195051ab-5126-4f3e-8c34-339f1fe2908f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:46:10.751961 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: WARNING py.warnings [None req-195051ab-5126-4f3e-8c34-339f1fe2908f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 23:46:10.751961 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: warnings.warn(msg) Jul 13 23:46:10.751961 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: Jul 13 23:46:10.752802 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e4d12-1045-49af-95b8-2c9a48b5c8a7 admin admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:46:10.753192 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195051ab-5126-4f3e-8c34-339f1fe2908f admin admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:46:10.787448 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 587/1169] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 13 23:46:10 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 23:46:10.788854 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 583/1170] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 13 23:46:10 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 23:46:10.792105 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195051ab-5126-4f3e-8c34-339f1fe2908f admin admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:46:10.792245 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e4d12-1045-49af-95b8-2c9a48b5c8a7 admin admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:46:10.853447 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e4d12-1045-49af-95b8-2c9a48b5c8a7 admin admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:46:10.853874 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195051ab-5126-4f3e-8c34-339f1fe2908f admin admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:46:10.860610 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb42721-c736-4004-a303-aea6b7b3b3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c258143da34685aa94a405e9ab3d07', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:46:10.860794 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d1ce6-846d-486c-af73-91c34bbb37a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c258143da34685aa94a405e9ab3d07', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:46:10.861458 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb42721-c736-4004-a303-aea6b7b3b3d9 admin admin] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:10.861592 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d1ce6-846d-486c-af73-91c34bbb37a5 admin admin] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:10.861796 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb42721-c736-4004-a303-aea6b7b3b3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:10.861909 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d1ce6-846d-486c-af73-91c34bbb37a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:10.862007 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb42721-c736-4004-a303-aea6b7b3b3d9 admin admin] PATH_INFO: `/v3/users` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:10.862098 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d1ce6-846d-486c-af73-91c34bbb37a5 admin admin] PATH_INFO: `/v3/users` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:10.862702 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d1ce6-846d-486c-af73-91c34bbb37a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:46:10.862827 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb42721-c736-4004-a303-aea6b7b3b3d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:46:10.863760 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: WARNING py.warnings [None req-ebb42721-c736-4004-a303-aea6b7b3b3d9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 23:46:10.863760 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: warnings.warn(msg) Jul 13 23:46:10.863760 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: Jul 13 23:46:10.864661 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d1ce6-846d-486c-af73-91c34bbb37a5 admin admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:46:10.865021 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb42721-c736-4004-a303-aea6b7b3b3d9 admin admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:46:10.885139 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 588/1171] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 13 23:46:10 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 23:46:10.890055 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 584/1172] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 13 23:46:10 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 23:46:10.890204 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb42721-c736-4004-a303-aea6b7b3b3d9 admin admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:46:10.894065 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d1ce6-846d-486c-af73-91c34bbb37a5 admin admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:46:10.900195 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb42721-c736-4004-a303-aea6b7b3b3d9 admin admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:46:10.904402 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d1ce6-846d-486c-af73-91c34bbb37a5 admin admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:46:10.905632 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d76fb-6192-49bf-bdb9-b0ccabed19df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c258143da34685aa94a405e9ab3d07', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:46:10.906288 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d76fb-6192-49bf-bdb9-b0ccabed19df admin admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:10.906574 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d76fb-6192-49bf-bdb9-b0ccabed19df admin admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:10.906879 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d76fb-6192-49bf-bdb9-b0ccabed19df admin admin] PATH_INFO: `/v3/roles` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:10.907601 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d76fb-6192-49bf-bdb9-b0ccabed19df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:46:10.909404 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d76fb-6192-49bf-bdb9-b0ccabed19df admin admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:46:10.909576 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec3c49-6a63-49a1-bdc3-51806849c38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c258143da34685aa94a405e9ab3d07', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:46:10.910235 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec3c49-6a63-49a1-bdc3-51806849c38e admin admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:10.910537 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec3c49-6a63-49a1-bdc3-51806849c38e admin admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:10.910816 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec3c49-6a63-49a1-bdc3-51806849c38e admin admin] PATH_INFO: `/v3/roles` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:10.911543 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec3c49-6a63-49a1-bdc3-51806849c38e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:46:10.913177 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec3c49-6a63-49a1-bdc3-51806849c38e admin admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:46:10.919483 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 589/1173] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 13 23:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 23:46:10.923416 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d76fb-6192-49bf-bdb9-b0ccabed19df admin admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:46:10.923561 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 585/1174] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 13 23:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 23:46:10.927297 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec3c49-6a63-49a1-bdc3-51806849c38e admin admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:46:10.933621 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d76fb-6192-49bf-bdb9-b0ccabed19df admin admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:46:10.936931 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec3c49-6a63-49a1-bdc3-51806849c38e admin admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:46:10.938227 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b0c07c-ee92-4193-a422-91a53937cd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c258143da34685aa94a405e9ab3d07', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:46:10.938872 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0c07c-ee92-4193-a422-91a53937cd27 admin admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:10.939154 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0c07c-ee92-4193-a422-91a53937cd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:10.939427 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0c07c-ee92-4193-a422-91a53937cd27 admin admin] PATH_INFO: `/v3/roles` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:10.940137 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b0c07c-ee92-4193-a422-91a53937cd27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:46:10.941480 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7efb9-1cda-4e2b-8609-eb79ff4e4c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c258143da34685aa94a405e9ab3d07', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:46:10.941747 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b0c07c-ee92-4193-a422-91a53937cd27 admin admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:46:10.942114 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7efb9-1cda-4e2b-8609-eb79ff4e4c9e admin admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:10.942397 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7efb9-1cda-4e2b-8609-eb79ff4e4c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:10.942669 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7efb9-1cda-4e2b-8609-eb79ff4e4c9e admin admin] PATH_INFO: `/v3/roles` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:10.943378 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a7efb9-1cda-4e2b-8609-eb79ff4e4c9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:46:10.944978 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a7efb9-1cda-4e2b-8609-eb79ff4e4c9e admin admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:46:10.952675 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 590/1175] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 13 23:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 23:46:10.955961 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 586/1176] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 13 23:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 23:46:10.956900 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b0c07c-ee92-4193-a422-91a53937cd27 admin admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:46:10.959436 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7efb9-1cda-4e2b-8609-eb79ff4e4c9e admin admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:46:10.966592 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b0c07c-ee92-4193-a422-91a53937cd27 admin admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:46:10.969724 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7efb9-1cda-4e2b-8609-eb79ff4e4c9e admin admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:46:10.971846 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971810e6-da94-45e1-a025-2a6fc3817f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c258143da34685aa94a405e9ab3d07', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:46:10.972707 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971810e6-da94-45e1-a025-2a6fc3817f9b admin admin] REQUEST_METHOD: `PUT` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:10.973025 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971810e6-da94-45e1-a025-2a6fc3817f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:10.973304 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971810e6-da94-45e1-a025-2a6fc3817f9b admin admin] PATH_INFO: `/v3/projects/c59955bf7cca41bf9f58e7fdfc2818e7/users/aa203abc047443588d0dd6867f25ecc0/roles/69842edf01cf43eb814bb066f9652f48` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:10.974175 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab829be9-664a-4ba8-bf70-ee2ec449a226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c258143da34685aa94a405e9ab3d07', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:46:10.975026 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab829be9-664a-4ba8-bf70-ee2ec449a226 admin admin] REQUEST_METHOD: `PUT` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:10.975305 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab829be9-664a-4ba8-bf70-ee2ec449a226 admin admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:10.975581 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab829be9-664a-4ba8-bf70-ee2ec449a226 admin admin] PATH_INFO: `/v3/projects/060823b0a7404c55b661696da28762db/users/17ada9eb0ec7413599ebeeffd2ab9cde/roles/69842edf01cf43eb814bb066f9652f48` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:10.987911 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971810e6-da94-45e1-a025-2a6fc3817f9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c59955bf7cca41bf9f58e7fdfc2818e7, user_id=aa203abc047443588d0dd6867f25ecc0, role_id=69842edf01cf43eb814bb066f9652f48)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:46:10.990376 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab829be9-664a-4ba8-bf70-ee2ec449a226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=060823b0a7404c55b661696da28762db, user_id=17ada9eb0ec7413599ebeeffd2ab9cde, role_id=69842edf01cf43eb814bb066f9652f48)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:46:10.990595 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971810e6-da94-45e1-a025-2a6fc3817f9b admin admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:46:10.991403 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: WARNING py.warnings [None req-ab829be9-664a-4ba8-bf70-ee2ec449a226 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 23:46:10.991403 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: warnings.warn(msg) Jul 13 23:46:10.991403 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: Jul 13 23:46:10.993432 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab829be9-664a-4ba8-bf70-ee2ec449a226 admin admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:46:11.004498 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 591/1177] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 13 23:46:10 2022] PUT /identity/v3/projects/c59955bf7cca41bf9f58e7fdfc2818e7/users/aa203abc047443588d0dd6867f25ecc0/roles/69842edf01cf43eb814bb066f9652f48 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 23:46:11.008722 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 587/1178] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 13 23:46:10 2022] PUT /identity/v3/projects/060823b0a7404c55b661696da28762db/users/17ada9eb0ec7413599ebeeffd2ab9cde/roles/69842edf01cf43eb814bb066f9652f48 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 23:46:11.010687 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2a436-7945-41a2-a50a-48e4a20a1746 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:11.010983 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2a436-7945-41a2-a50a-48e4a20a1746 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:11.011249 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d135e-f315-43eb-8300-ab846cd3a786 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:11.011349 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2a436-7945-41a2-a50a-48e4a20a1746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:11.011528 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d135e-f315-43eb-8300-ab846cd3a786 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:11.011804 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d135e-f315-43eb-8300-ab846cd3a786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:11.029619 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-0e6d135e-f315-43eb-8300-ab846cd3a786 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:46:11.030299 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-88a2a436-7945-41a2-a50a-48e4a20a1746 None None] MFA Rules not processed for user `d4a30dab8dc6492bb2bda65abda06d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:46:11.030831 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-0e6d135e-f315-43eb-8300-ab846cd3a786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:46:11.031484 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-88a2a436-7945-41a2-a50a-48e4a20a1746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:46:11.076967 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:46:11.080276 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:46:11.096109 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 588/1179] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 13 23:46:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 23:46:11.098746 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 592/1180] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 13 23:46:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 23:46:11.108349 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d135e-f315-43eb-8300-ab846cd3a786 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:46:11.108728 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2a436-7945-41a2-a50a-48e4a20a1746 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:46:11.163416 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d135e-f315-43eb-8300-ab846cd3a786 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:46:11.167005 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88f01c-2620-427e-99f6-81d4a497dfbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05f1ce71ea7c4301ae0bfc84a06c9c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:46:11.167222 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2a436-7945-41a2-a50a-48e4a20a1746 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:46:11.167647 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88f01c-2620-427e-99f6-81d4a497dfbd service neutron] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:11.167928 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88f01c-2620-427e-99f6-81d4a497dfbd service neutron] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:11.168986 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88f01c-2620-427e-99f6-81d4a497dfbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:11.171684 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55e223-1c7e-48e9-a035-1bdadace8147 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05f1ce71ea7c4301ae0bfc84a06c9c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:46:11.172321 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55e223-1c7e-48e9-a035-1bdadace8147 service neutron] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:11.172603 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55e223-1c7e-48e9-a035-1bdadace8147 service neutron] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:11.172903 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55e223-1c7e-48e9-a035-1bdadace8147 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:11.178041 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88f01c-2620-427e-99f6-81d4a497dfbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:46:11.179466 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88f01c-2620-427e-99f6-81d4a497dfbd service neutron] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:46:11.181865 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c55e223-1c7e-48e9-a035-1bdadace8147 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:46:11.183281 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c55e223-1c7e-48e9-a035-1bdadace8147 service neutron] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:46:11.189634 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 589/1181] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:46:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:46:11.193252 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 593/1182] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:46:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 23:46:16.568236 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389d6aa-6933-4d6c-8219-64c7df9e95a0 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:16.569138 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389d6aa-6933-4d6c-8219-64c7df9e95a0 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:16.569138 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389d6aa-6933-4d6c-8219-64c7df9e95a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:16.599152 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-5389d6aa-6933-4d6c-8219-64c7df9e95a0 None None] MFA Rules not processed for user `17ada9eb0ec7413599ebeeffd2ab9cde`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:46:16.600359 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-5389d6aa-6933-4d6c-8219-64c7df9e95a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:46:16.691273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 590/1183] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 13 23:46:16 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 23:46:16.695426 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55e223-1c7e-48e9-a035-1bdadace8147 service neutron] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:46:16.718202 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55e223-1c7e-48e9-a035-1bdadace8147 service neutron] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:46:16.727099 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a24391-812a-416a-ba06-f00a2512291b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c258143da34685aa94a405e9ab3d07', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:46:16.728239 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a24391-812a-416a-ba06-f00a2512291b admin admin] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:16.728675 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a24391-812a-416a-ba06-f00a2512291b admin admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:16.729827 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a24391-812a-416a-ba06-f00a2512291b admin admin] PATH_INFO: `/v3/projects` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:16.731590 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a24391-812a-416a-ba06-f00a2512291b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:46:16.733902 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a24391-812a-416a-ba06-f00a2512291b admin admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:46:16.779437 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 594/1184] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 13 23:46:16 2022] POST /identity/v3/projects => generated 383 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 23:46:16.783375 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5389d6aa-6933-4d6c-8219-64c7df9e95a0 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:46:16.812444 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5389d6aa-6933-4d6c-8219-64c7df9e95a0 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:46:16.898584 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdbf1c3-df38-4c0f-88ed-2aef3cd45aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c258143da34685aa94a405e9ab3d07', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:46:16.899381 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbf1c3-df38-4c0f-88ed-2aef3cd45aa9 admin admin] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:16.899738 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbf1c3-df38-4c0f-88ed-2aef3cd45aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:16.900085 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbf1c3-df38-4c0f-88ed-2aef3cd45aa9 admin admin] PATH_INFO: `/v3/users` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:16.900887 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdbf1c3-df38-4c0f-88ed-2aef3cd45aa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:46:16.904719 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdbf1c3-df38-4c0f-88ed-2aef3cd45aa9 admin admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:46:16.944015 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 591/1185] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 13 23:46:16 2022] POST /identity/v3/users => generated 298 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 23:46:16.948193 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a24391-812a-416a-ba06-f00a2512291b admin admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:46:16.967676 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a24391-812a-416a-ba06-f00a2512291b admin admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:46:16.972528 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0424a-e7f3-4136-90e4-2e071f5b66f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c258143da34685aa94a405e9ab3d07', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:46:16.973444 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0424a-e7f3-4136-90e4-2e071f5b66f4 admin admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:16.973623 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0424a-e7f3-4136-90e4-2e071f5b66f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:16.974035 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0424a-e7f3-4136-90e4-2e071f5b66f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:16.974827 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0424a-e7f3-4136-90e4-2e071f5b66f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:46:16.976859 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0424a-e7f3-4136-90e4-2e071f5b66f4 admin admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:46:16.993854 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 595/1186] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 13 23:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 23:46:16.994857 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdbf1c3-df38-4c0f-88ed-2aef3cd45aa9 admin admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:46:17.008262 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdbf1c3-df38-4c0f-88ed-2aef3cd45aa9 admin admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:46:17.020544 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea3a0c-0d87-4762-8395-76e83939c4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c258143da34685aa94a405e9ab3d07', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:46:17.021559 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea3a0c-0d87-4762-8395-76e83939c4c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:17.021854 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea3a0c-0d87-4762-8395-76e83939c4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:17.022128 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea3a0c-0d87-4762-8395-76e83939c4c4 admin admin] PATH_INFO: `/v3/projects/335131f0c252439298de8e1b4d1a7997/users/112e772304cf44f5966336e9cc4370f9/roles/46deff0e06964626a5600c9641454603` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:17.025906 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:46:17.043761 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beea3a0c-0d87-4762-8395-76e83939c4c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=335131f0c252439298de8e1b4d1a7997, user_id=112e772304cf44f5966336e9cc4370f9, role_id=46deff0e06964626a5600c9641454603)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:46:17.048677 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beea3a0c-0d87-4762-8395-76e83939c4c4 admin admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:46:17.068888 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 592/1187] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 13 23:46:16 2022] PUT /identity/v3/projects/335131f0c252439298de8e1b4d1a7997/users/112e772304cf44f5966336e9cc4370f9/roles/46deff0e06964626a5600c9641454603 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 23:46:17.071680 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0424a-e7f3-4136-90e4-2e071f5b66f4 admin admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:46:17.083140 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0424a-e7f3-4136-90e4-2e071f5b66f4 admin admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:46:17.157579 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0a73c-4737-4aa4-90b9-0126b51e27b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c258143da34685aa94a405e9ab3d07', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:46:17.158782 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0a73c-4737-4aa4-90b9-0126b51e27b6 admin admin] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:17.158782 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0a73c-4737-4aa4-90b9-0126b51e27b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:17.158782 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0a73c-4737-4aa4-90b9-0126b51e27b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:17.159511 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c0a73c-4737-4aa4-90b9-0126b51e27b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:46:17.161445 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c0a73c-4737-4aa4-90b9-0126b51e27b6 admin admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:46:17.175823 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 596/1188] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 13 23:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 23:46:17.177296 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea3a0c-0d87-4762-8395-76e83939c4c4 admin admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:46:17.192057 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aadecc-bc60-41e6-8179-b4d8507c9d3a None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:17.192361 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aadecc-bc60-41e6-8179-b4d8507c9d3a None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:17.192649 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aadecc-bc60-41e6-8179-b4d8507c9d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:17.196388 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea3a0c-0d87-4762-8395-76e83939c4c4 admin admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:46:17.201623 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109bd93-5f13-4e0d-aaa7-99d8155394e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c258143da34685aa94a405e9ab3d07', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:46:17.202712 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109bd93-5f13-4e0d-aaa7-99d8155394e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:17.203839 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109bd93-5f13-4e0d-aaa7-99d8155394e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:17.204122 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109bd93-5f13-4e0d-aaa7-99d8155394e0 admin admin] PATH_INFO: `/v3/projects/335131f0c252439298de8e1b4d1a7997/users/112e772304cf44f5966336e9cc4370f9/roles/46deff0e06964626a5600c9641454603` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:17.206225 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f109bd93-5f13-4e0d-aaa7-99d8155394e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=335131f0c252439298de8e1b4d1a7997, user_id=112e772304cf44f5966336e9cc4370f9, role_id=46deff0e06964626a5600c9641454603)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:46:17.209383 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f109bd93-5f13-4e0d-aaa7-99d8155394e0 admin admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:46:17.233118 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-47aadecc-bc60-41e6-8179-b4d8507c9d3a None None] MFA Rules not processed for user `aa203abc047443588d0dd6867f25ecc0`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:46:17.234506 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-47aadecc-bc60-41e6-8179-b4d8507c9d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:46:17.235219 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 593/1189] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 13 23:46:17 2022] PUT /identity/v3/projects/335131f0c252439298de8e1b4d1a7997/users/112e772304cf44f5966336e9cc4370f9/roles/46deff0e06964626a5600c9641454603 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 23:46:17.322649 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:46:17.384996 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 597/1190] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 13 23:46:17 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:46:17.385448 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109bd93-5f13-4e0d-aaa7-99d8155394e0 admin admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:46:17.495440 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109bd93-5f13-4e0d-aaa7-99d8155394e0 admin admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:46:17.508194 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c1e30-795f-432d-9b5b-5873dafdf702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c258143da34685aa94a405e9ab3d07', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:46:17.509074 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c1e30-795f-432d-9b5b-5873dafdf702 admin admin] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:17.509470 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c1e30-795f-432d-9b5b-5873dafdf702 admin admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:17.510330 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c1e30-795f-432d-9b5b-5873dafdf702 admin admin] PATH_INFO: `/v3/projects` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:17.510742 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c1e30-795f-432d-9b5b-5873dafdf702 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:46:17.513283 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c1e30-795f-432d-9b5b-5873dafdf702 admin admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:46:17.564512 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 594/1191] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 13 23:46:17 2022] POST /identity/v3/projects => generated 377 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 23:46:17.566284 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aadecc-bc60-41e6-8179-b4d8507c9d3a None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:46:17.581693 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aadecc-bc60-41e6-8179-b4d8507c9d3a None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:46:17.660443 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ae249-d6ca-45e5-938c-04f0e399426a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c258143da34685aa94a405e9ab3d07', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:46:17.661347 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ae249-d6ca-45e5-938c-04f0e399426a admin admin] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:17.661735 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ae249-d6ca-45e5-938c-04f0e399426a admin admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:17.662113 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ae249-d6ca-45e5-938c-04f0e399426a admin admin] PATH_INFO: `/v3/users` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:17.663053 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ae249-d6ca-45e5-938c-04f0e399426a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:46:17.665470 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ae249-d6ca-45e5-938c-04f0e399426a admin admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:46:17.692449 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 598/1192] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 13 23:46:17 2022] POST /identity/v3/users => generated 295 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 23:46:17.696478 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c1e30-795f-432d-9b5b-5873dafdf702 admin admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:46:17.709645 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c1e30-795f-432d-9b5b-5873dafdf702 admin admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:46:17.721143 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb3149-2ab7-4495-ad74-d254044cbcba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c258143da34685aa94a405e9ab3d07', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:46:17.721766 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb3149-2ab7-4495-ad74-d254044cbcba admin admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:17.722057 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb3149-2ab7-4495-ad74-d254044cbcba admin admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:17.722336 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb3149-2ab7-4495-ad74-d254044cbcba admin admin] PATH_INFO: `/v3/roles` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:17.724236 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcb3149-2ab7-4495-ad74-d254044cbcba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:46:17.726166 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcb3149-2ab7-4495-ad74-d254044cbcba admin admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:46:17.744854 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ae249-d6ca-45e5-938c-04f0e399426a admin admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:46:17.756024 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ae249-d6ca-45e5-938c-04f0e399426a admin admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:46:17.756966 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 595/1193] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 13 23:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 23:46:17.761341 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec4172-cbae-4a3b-af27-eb8b3f6d088c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c258143da34685aa94a405e9ab3d07', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:46:17.762402 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec4172-cbae-4a3b-af27-eb8b3f6d088c admin admin] REQUEST_METHOD: `PUT` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:17.762976 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec4172-cbae-4a3b-af27-eb8b3f6d088c admin admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:17.763415 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec4172-cbae-4a3b-af27-eb8b3f6d088c admin admin] PATH_INFO: `/v3/projects/e5eff6225bce43c3877e3b22b0b68f07/users/8a8728ecd647445681cd829d615ed28c/roles/46deff0e06964626a5600c9641454603` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:17.782423 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec4172-cbae-4a3b-af27-eb8b3f6d088c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5eff6225bce43c3877e3b22b0b68f07, user_id=8a8728ecd647445681cd829d615ed28c, role_id=46deff0e06964626a5600c9641454603)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:46:17.785545 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec4172-cbae-4a3b-af27-eb8b3f6d088c admin admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:46:17.825526 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb3149-2ab7-4495-ad74-d254044cbcba admin admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:46:17.847767 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 599/1194] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 13 23:46:17 2022] PUT /identity/v3/projects/e5eff6225bce43c3877e3b22b0b68f07/users/8a8728ecd647445681cd829d615ed28c/roles/46deff0e06964626a5600c9641454603 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 23:46:17.851434 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb3149-2ab7-4495-ad74-d254044cbcba admin admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:46:17.943634 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c014ea-02e5-40ec-b2ec-b0c5e6069937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c258143da34685aa94a405e9ab3d07', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:46:17.944492 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c014ea-02e5-40ec-b2ec-b0c5e6069937 admin admin] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:17.944916 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c014ea-02e5-40ec-b2ec-b0c5e6069937 admin admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:17.945311 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c014ea-02e5-40ec-b2ec-b0c5e6069937 admin admin] PATH_INFO: `/v3/roles` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:17.946402 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c014ea-02e5-40ec-b2ec-b0c5e6069937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:46:17.948339 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c014ea-02e5-40ec-b2ec-b0c5e6069937 admin admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:46:17.968784 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec4172-cbae-4a3b-af27-eb8b3f6d088c admin admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:46:17.975181 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 596/1195] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 13 23:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 23:46:17.981501 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec4172-cbae-4a3b-af27-eb8b3f6d088c admin admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:46:17.987013 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92a95a9-22c9-4128-a04a-a283e360bf4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c258143da34685aa94a405e9ab3d07', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:46:17.988285 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a95a9-22c9-4128-a04a-a283e360bf4c admin admin] REQUEST_METHOD: `PUT` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:17.988486 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a95a9-22c9-4128-a04a-a283e360bf4c admin admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:17.988773 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a95a9-22c9-4128-a04a-a283e360bf4c admin admin] PATH_INFO: `/v3/projects/e5eff6225bce43c3877e3b22b0b68f07/users/8a8728ecd647445681cd829d615ed28c/roles/46deff0e06964626a5600c9641454603` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:17.990857 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92a95a9-22c9-4128-a04a-a283e360bf4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5eff6225bce43c3877e3b22b0b68f07, user_id=8a8728ecd647445681cd829d615ed28c, role_id=46deff0e06964626a5600c9641454603)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:46:17.993575 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92a95a9-22c9-4128-a04a-a283e360bf4c admin admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:46:18.010071 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 600/1196] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 13 23:46:17 2022] PUT /identity/v3/projects/e5eff6225bce43c3877e3b22b0b68f07/users/8a8728ecd647445681cd829d615ed28c/roles/46deff0e06964626a5600c9641454603 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 23:46:23.306597 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f973be0-3c56-4f43-ad84-9b0a6474c9f3 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:23.307170 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f973be0-3c56-4f43-ad84-9b0a6474c9f3 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:23.313150 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f973be0-3c56-4f43-ad84-9b0a6474c9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:23.361290 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-3f973be0-3c56-4f43-ad84-9b0a6474c9f3 None None] MFA Rules not processed for user `112e772304cf44f5966336e9cc4370f9`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:46:23.362732 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-3f973be0-3c56-4f43-ad84-9b0a6474c9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:46:23.431055 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:46:23.533866 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 597/1197] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 13 23:46:23 2022] POST /identity/v3/auth/tokens => generated 2877 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:46:23.550125 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92a95a9-22c9-4128-a04a-a283e360bf4c admin admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:46:23.552145 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-f92a95a9-22c9-4128-a04a-a283e360bf4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:46:23.681435 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92a95a9-22c9-4128-a04a-a283e360bf4c admin admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:46:23.686474 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68fd91-ec11-470b-8739-3cd10308d739 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cdeb3131bc419f98ab11aaa4562d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:46:23.687247 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68fd91-ec11-470b-8739-3cd10308d739 service glance] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:23.687597 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68fd91-ec11-470b-8739-3cd10308d739 service glance] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:23.687942 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68fd91-ec11-470b-8739-3cd10308d739 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:23.738396 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:46:23.767324 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68fd91-ec11-470b-8739-3cd10308d739 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:46:23.769186 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68fd91-ec11-470b-8739-3cd10308d739 service glance] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:46:23.793436 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 601/1198] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:46:23 2022] GET /identity/v3/auth/tokens => generated 2810 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:46:24.210720 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62657c9c-e2aa-481e-b9b2-673c05164178 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:24.210720 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62657c9c-e2aa-481e-b9b2-673c05164178 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:24.210720 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62657c9c-e2aa-481e-b9b2-673c05164178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:24.264959 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-62657c9c-e2aa-481e-b9b2-673c05164178 None None] MFA Rules not processed for user `8a8728ecd647445681cd829d615ed28c`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:46:24.266532 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-62657c9c-e2aa-481e-b9b2-673c05164178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:46:24.386097 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 598/1199] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 13 23:46:24 2022] POST /identity/v3/auth/tokens => generated 2871 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:46:24.407157 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68fd91-ec11-470b-8739-3cd10308d739 service glance] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:46:24.423462 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68fd91-ec11-470b-8739-3cd10308d739 service glance] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:46:24.427970 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb6a50-b286-4dc5-879f-b23a18095f42 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cdeb3131bc419f98ab11aaa4562d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:46:24.428721 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb6a50-b286-4dc5-879f-b23a18095f42 service glance] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:24.429337 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb6a50-b286-4dc5-879f-b23a18095f42 service glance] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:24.429701 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb6a50-b286-4dc5-879f-b23a18095f42 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:24.547198 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb6a50-b286-4dc5-879f-b23a18095f42 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:46:24.550605 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb6a50-b286-4dc5-879f-b23a18095f42 service glance] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:46:24.567990 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 602/1200] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:46:24 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:46:32.548988 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8b260-6792-408b-b215-09215060bb71 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:32.549495 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8b260-6792-408b-b215-09215060bb71 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:32.549594 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8b260-6792-408b-b215-09215060bb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:32.567353 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-f3c8b260-6792-408b-b215-09215060bb71 None None] MFA Rules not processed for user `17ada9eb0ec7413599ebeeffd2ab9cde`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:46:32.568552 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-f3c8b260-6792-408b-b215-09215060bb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:46:32.576637 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 599/1201] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 13 23:46:32 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:46:32.877125 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573434c0-73ce-4859-ab05-c29d581e39a7 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:32.877667 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573434c0-73ce-4859-ab05-c29d581e39a7 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:32.877753 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573434c0-73ce-4859-ab05-c29d581e39a7 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:32.879056 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 603/1202] 10.222.0.16 () {54 vars in 961 bytes} [Wed Jul 13 23:46:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:46:32.884279 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b6d60-51e0-4ee2-ad9f-269c4adb3c94 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:32.884642 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b6d60-51e0-4ee2-ad9f-269c4adb3c94 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:32.884954 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b6d60-51e0-4ee2-ad9f-269c4adb3c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:32.916935 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-140b6d60-51e0-4ee2-ad9f-269c4adb3c94 None None] MFA Rules not processed for user `a7e276c4bd434c028274e059a73c4060`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:46:32.919250 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-140b6d60-51e0-4ee2-ad9f-269c4adb3c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:46:32.998420 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 600/1203] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Jul 13 23:46:32 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:46:32.999847 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a1620-a5c4-48a4-9f33-a6e7b2f992c5 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:33.000197 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a1620-a5c4-48a4-9f33-a6e7b2f992c5 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:33.000547 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a1620-a5c4-48a4-9f33-a6e7b2f992c5 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:33.002614 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 604/1204] 10.222.0.16 () {54 vars in 912 bytes} [Wed Jul 13 23:46:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 23:46:33.007457 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f87b27-06ce-45c2-8251-7b0891bf489a None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:33.007755 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f87b27-06ce-45c2-8251-7b0891bf489a None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:33.008036 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f87b27-06ce-45c2-8251-7b0891bf489a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:33.026721 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-40f87b27-06ce-45c2-8251-7b0891bf489a None None] MFA Rules not processed for user `a7e276c4bd434c028274e059a73c4060`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:46:33.028534 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-40f87b27-06ce-45c2-8251-7b0891bf489a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:46:33.042045 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 601/1205] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Jul 13 23:46:33 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:46:33.050240 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a1620-a5c4-48a4-9f33-a6e7b2f992c5 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:46:33.051930 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-151a1620-a5c4-48a4-9f33-a6e7b2f992c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:46:33.070544 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a1620-a5c4-48a4-9f33-a6e7b2f992c5 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:46:33.074261 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc89dedf-a06e-454a-872a-f29926f6e1e0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cdeb3131bc419f98ab11aaa4562d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:46:33.074946 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89dedf-a06e-454a-872a-f29926f6e1e0 service glance] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:33.075235 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89dedf-a06e-454a-872a-f29926f6e1e0 service glance] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:33.075501 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89dedf-a06e-454a-872a-f29926f6e1e0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:33.088745 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc89dedf-a06e-454a-872a-f29926f6e1e0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:46:33.091779 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc89dedf-a06e-454a-872a-f29926f6e1e0 service glance] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:46:33.103182 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 605/1206] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:46:33 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:46:33.456484 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881890f8-6e57-4cb9-a69f-45b7d0646811 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:33.456905 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881890f8-6e57-4cb9-a69f-45b7d0646811 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:33.457078 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881890f8-6e57-4cb9-a69f-45b7d0646811 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:33.458960 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 602/1207] 10.222.0.16 () {54 vars in 912 bytes} [Wed Jul 13 23:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:46:33.464714 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adcb19-afb0-4378-ba88-a12cdd77ba44 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:33.465307 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adcb19-afb0-4378-ba88-a12cdd77ba44 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:33.465871 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adcb19-afb0-4378-ba88-a12cdd77ba44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:33.505088 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-b2adcb19-afb0-4378-ba88-a12cdd77ba44 None None] MFA Rules not processed for user `05f1ce71ea7c4301ae0bfc84a06c9c38`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:46:33.506304 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-b2adcb19-afb0-4378-ba88-a12cdd77ba44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:46:33.568291 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 606/1208] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Jul 13 23:46:33 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:46:33.581519 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881890f8-6e57-4cb9-a69f-45b7d0646811 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:46:33.602757 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881890f8-6e57-4cb9-a69f-45b7d0646811 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:46:33.608855 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924661c-b457-4b03-b890-2f45b8775276 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05f1ce71ea7c4301ae0bfc84a06c9c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:46:33.610519 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924661c-b457-4b03-b890-2f45b8775276 service neutron] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:33.611172 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924661c-b457-4b03-b890-2f45b8775276 service neutron] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:33.611449 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924661c-b457-4b03-b890-2f45b8775276 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:33.629016 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924661c-b457-4b03-b890-2f45b8775276 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:46:33.631962 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924661c-b457-4b03-b890-2f45b8775276 service neutron] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:46:33.642653 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 603/1209] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:46:33 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:46:34.217184 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddede9a-5c4d-4562-9d92-6dbf4fd344b2 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:34.217826 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddede9a-5c4d-4562-9d92-6dbf4fd344b2 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:34.218240 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddede9a-5c4d-4562-9d92-6dbf4fd344b2 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:34.226351 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 607/1210] 10.222.0.16 () {54 vars in 961 bytes} [Wed Jul 13 23:46:34 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:46:34.233273 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6988e-06ff-4b11-ba69-94231e145ffc None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:34.233680 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6988e-06ff-4b11-ba69-94231e145ffc None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:34.234034 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6988e-06ff-4b11-ba69-94231e145ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:34.260178 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-74e6988e-06ff-4b11-ba69-94231e145ffc None None] MFA Rules not processed for user `a7e276c4bd434c028274e059a73c4060`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:46:34.262293 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-74e6988e-06ff-4b11-ba69-94231e145ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:46:34.272966 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8cfdac-5dd4-4550-89c3-c00b0133927a None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:34.273601 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8cfdac-5dd4-4550-89c3-c00b0133927a None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:34.274456 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8cfdac-5dd4-4550-89c3-c00b0133927a None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:34.277699 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 608/1211] 10.222.0.16 () {54 vars in 960 bytes} [Wed Jul 13 23:46:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:46:34.279909 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 604/1212] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Jul 13 23:46:34 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:46:34.285362 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82de24-3ac7-4074-b0d2-380ae2f3f73b None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:34.285745 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82de24-3ac7-4074-b0d2-380ae2f3f73b None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:34.286127 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82de24-3ac7-4074-b0d2-380ae2f3f73b None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:34.288226 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 609/1213] 10.222.0.16 () {54 vars in 912 bytes} [Wed Jul 13 23:46:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:46:34.289332 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74229700-0570-4787-aa35-5fbae64b4590 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:34.290062 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74229700-0570-4787-aa35-5fbae64b4590 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:34.291716 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74229700-0570-4787-aa35-5fbae64b4590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:34.295013 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c00125-0f31-428e-b79c-159cebec78aa None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:34.295415 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c00125-0f31-428e-b79c-159cebec78aa None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:34.295894 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c00125-0f31-428e-b79c-159cebec78aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:34.306745 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=100 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:46:34.322823 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-74229700-0570-4787-aa35-5fbae64b4590 None None] MFA Rules not processed for user `4fbb147d802e48a082c7d928714f1dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:46:34.324796 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-74229700-0570-4787-aa35-5fbae64b4590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:46:34.361083 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-f7c00125-0f31-428e-b79c-159cebec78aa None None] MFA Rules not processed for user `a7e276c4bd434c028274e059a73c4060`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:46:34.365380 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-f7c00125-0f31-428e-b79c-159cebec78aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:46:34.391445 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 610/1214] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Jul 13 23:46:34 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 23:46:34.405358 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c00125-0f31-428e-b79c-159cebec78aa None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:46:34.420440 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c00125-0f31-428e-b79c-159cebec78aa None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:46:34.430998 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108f2ca-4ae8-4a49-8196-7ca12f8550d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05f1ce71ea7c4301ae0bfc84a06c9c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:46:34.433976 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108f2ca-4ae8-4a49-8196-7ca12f8550d8 service neutron] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:34.434275 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108f2ca-4ae8-4a49-8196-7ca12f8550d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:34.434555 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108f2ca-4ae8-4a49-8196-7ca12f8550d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:34.447965 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108f2ca-4ae8-4a49-8196-7ca12f8550d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:46:34.450693 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108f2ca-4ae8-4a49-8196-7ca12f8550d8 service neutron] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:46:34.463421 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 611/1215] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:46:34 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:46:34.464173 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 605/1216] 10.222.0.16 () {58 vars in 1057 bytes} [Wed Jul 13 23:46:34 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:46:34.472390 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108f2ca-4ae8-4a49-8196-7ca12f8550d8 service neutron] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:46:34.489485 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108f2ca-4ae8-4a49-8196-7ca12f8550d8 service neutron] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:46:34.504838 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26012fb6-7af2-4c3b-8661-1750c6ea0f48 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fbb147d802e48a082c7d928714f1dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:46:34.505527 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26012fb6-7af2-4c3b-8661-1750c6ea0f48 service placement] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:34.505815 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26012fb6-7af2-4c3b-8661-1750c6ea0f48 service placement] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:34.506109 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26012fb6-7af2-4c3b-8661-1750c6ea0f48 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:34.509168 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-26012fb6-7af2-4c3b-8661-1750c6ea0f48 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:46:34.543323 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26012fb6-7af2-4c3b-8661-1750c6ea0f48 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:46:34.545910 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26012fb6-7af2-4c3b-8661-1750c6ea0f48 service placement] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:46:34.580951 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 612/1217] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:46:34 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:46:44.438572 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=27 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:46:44.559893 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=87 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:46:44.572108 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5917def-a74b-4987-942e-923baba3f8ff None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:44.572408 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5917def-a74b-4987-942e-923baba3f8ff None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:44.572695 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5917def-a74b-4987-942e-923baba3f8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:44.593460 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-b5917def-a74b-4987-942e-923baba3f8ff None None] MFA Rules not processed for user `05f1ce71ea7c4301ae0bfc84a06c9c38`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:46:44.594671 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-b5917def-a74b-4987-942e-923baba3f8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:46:44.601267 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 606/1218] 10.222.0.65 () {58 vars in 1015 bytes} [Wed Jul 13 23:46:44 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:46:44.613730 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26012fb6-7af2-4c3b-8661-1750c6ea0f48 service placement] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:46:44.622660 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26012fb6-7af2-4c3b-8661-1750c6ea0f48 service placement] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:46:44.626166 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8d2bb-74bd-4123-a0df-33e52cc88959 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05f1ce71ea7c4301ae0bfc84a06c9c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:46:44.626784 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8d2bb-74bd-4123-a0df-33e52cc88959 service neutron] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:44.627062 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8d2bb-74bd-4123-a0df-33e52cc88959 service neutron] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:44.627335 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8d2bb-74bd-4123-a0df-33e52cc88959 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:44.634556 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a8d2bb-74bd-4123-a0df-33e52cc88959 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:46:44.636589 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a8d2bb-74bd-4123-a0df-33e52cc88959 service neutron] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:46:44.644854 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 613/1219] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:46:44 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:46:45.434222 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8619642-cfb2-4ce4-890c-c36060d6ff93 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:45.434605 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8619642-cfb2-4ce4-890c-c36060d6ff93 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:45.434929 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8619642-cfb2-4ce4-890c-c36060d6ff93 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:45.436766 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 607/1220] 10.222.0.16 () {54 vars in 921 bytes} [Wed Jul 13 23:46:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:46:45.480506 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d629b-c971-4637-b360-cfcf66e61892 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:45.480955 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d629b-c971-4637-b360-cfcf66e61892 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:45.481247 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d629b-c971-4637-b360-cfcf66e61892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:45.525293 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-9b5d629b-c971-4637-b360-cfcf66e61892 None None] MFA Rules not processed for user `a7e276c4bd434c028274e059a73c4060`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:46:45.525293 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-9b5d629b-c971-4637-b360-cfcf66e61892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:46:45.535118 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 614/1221] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Jul 13 23:46:45 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:46:45.562743 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8619642-cfb2-4ce4-890c-c36060d6ff93 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:46:45.580244 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8619642-cfb2-4ce4-890c-c36060d6ff93 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:46:45.583655 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdeedfe-befd-46ed-925e-9f83a1cace66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e276c4bd434c028274e059a73c4060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:46:45.584377 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdeedfe-befd-46ed-925e-9f83a1cace66 service nova] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:45.584730 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdeedfe-befd-46ed-925e-9f83a1cace66 service nova] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:45.585194 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdeedfe-befd-46ed-925e-9f83a1cace66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:45.598599 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdeedfe-befd-46ed-925e-9f83a1cace66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:46:45.600324 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdeedfe-befd-46ed-925e-9f83a1cace66 service nova] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:46:45.612616 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 608/1222] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:46:45 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:46:52.010354 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad256ff7-614e-4b1e-8d5f-7436689b997e None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:52.011672 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad256ff7-614e-4b1e-8d5f-7436689b997e None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:52.011672 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad256ff7-614e-4b1e-8d5f-7436689b997e None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:52.013497 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 615/1223] 10.222.0.16 () {54 vars in 921 bytes} [Wed Jul 13 23:46:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:46:52.022347 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd177e-047e-4455-b50f-d5263d67e8c4 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:52.022857 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd177e-047e-4455-b50f-d5263d67e8c4 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:52.022960 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd177e-047e-4455-b50f-d5263d67e8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:52.043942 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-a1cd177e-047e-4455-b50f-d5263d67e8c4 None None] MFA Rules not processed for user `a7e276c4bd434c028274e059a73c4060`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:46:52.045227 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-a1cd177e-047e-4455-b50f-d5263d67e8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:46:52.054486 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 609/1224] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Jul 13 23:46:52 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 23:46:52.074561 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad256ff7-614e-4b1e-8d5f-7436689b997e None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:46:52.089638 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad256ff7-614e-4b1e-8d5f-7436689b997e None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:46:52.095519 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae7d61-5ef2-4b98-8e85-754c7d4c7135 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e276c4bd434c028274e059a73c4060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:46:52.096157 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae7d61-5ef2-4b98-8e85-754c7d4c7135 service nova] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:46:52.096506 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae7d61-5ef2-4b98-8e85-754c7d4c7135 service nova] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:46:52.096754 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae7d61-5ef2-4b98-8e85-754c7d4c7135 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:46:52.106304 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcae7d61-5ef2-4b98-8e85-754c7d4c7135 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:46:52.107888 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcae7d61-5ef2-4b98-8e85-754c7d4c7135 service nova] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:46:52.117861 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 616/1225] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:46:52 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:47:02.037522 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=12 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:47:02.113680 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=15 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:47:03.826789 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd177e-047e-4455-b50f-d5263d67e8c4 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:47:03.836450 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd177e-047e-4455-b50f-d5263d67e8c4 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:47:03.840202 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c660ea-d2d1-4b13-b499-02c76bcdc4de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05f1ce71ea7c4301ae0bfc84a06c9c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:47:03.840748 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c660ea-d2d1-4b13-b499-02c76bcdc4de service neutron] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:47:03.841091 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c660ea-d2d1-4b13-b499-02c76bcdc4de service neutron] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:47:03.841367 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c660ea-d2d1-4b13-b499-02c76bcdc4de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:47:03.850316 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c660ea-d2d1-4b13-b499-02c76bcdc4de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:47:03.851781 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c660ea-d2d1-4b13-b499-02c76bcdc4de service neutron] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:47:03.862400 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 610/1226] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:47:03 2022] GET /identity/v3/auth/tokens => generated 2877 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:47:13.858046 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=6 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:47:23.543474 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dfd64c-0c16-4132-a0e7-d396b1a80d87 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:47:23.544102 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dfd64c-0c16-4132-a0e7-d396b1a80d87 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:47:23.544683 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dfd64c-0c16-4132-a0e7-d396b1a80d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:47:23.561697 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-34dfd64c-0c16-4132-a0e7-d396b1a80d87 None None] MFA Rules not processed for user `aa203abc047443588d0dd6867f25ecc0`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:47:23.562879 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-34dfd64c-0c16-4132-a0e7-d396b1a80d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:47:23.569661 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 617/1227] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 13 23:47:23 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:47:33.556568 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=3 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:47:47.463899 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d99e37-a769-4be6-9b41-e7843eb90588 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:47:47.464383 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d99e37-a769-4be6-9b41-e7843eb90588 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:47:47.464464 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d99e37-a769-4be6-9b41-e7843eb90588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:47:47.481692 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-33d99e37-a769-4be6-9b41-e7843eb90588 None None] MFA Rules not processed for user `aa203abc047443588d0dd6867f25ecc0`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:47:47.482871 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-33d99e37-a769-4be6-9b41-e7843eb90588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:47:47.489587 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 611/1228] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 13 23:47:47 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:47:57.476287 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=3 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:48:03.343763 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64215e-e4aa-4c68-9e86-fa0881dccd7d None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:48:03.344150 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64215e-e4aa-4c68-9e86-fa0881dccd7d None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:48:03.344318 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64215e-e4aa-4c68-9e86-fa0881dccd7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:48:03.361896 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-be64215e-e4aa-4c68-9e86-fa0881dccd7d None None] MFA Rules not processed for user `aa203abc047443588d0dd6867f25ecc0`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:48:03.363105 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-be64215e-e4aa-4c68-9e86-fa0881dccd7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:48:03.370881 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 618/1229] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 13 23:48:03 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:48:13.356749 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=3 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:49:03.442797 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a11f8-7c7f-4ad4-8bf5-55f53ea997fb None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:49:03.443303 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a11f8-7c7f-4ad4-8bf5-55f53ea997fb None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:49:03.443402 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a11f8-7c7f-4ad4-8bf5-55f53ea997fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:49:03.461482 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-aa6a11f8-7c7f-4ad4-8bf5-55f53ea997fb None None] MFA Rules not processed for user `aa203abc047443588d0dd6867f25ecc0`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:49:03.462679 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-aa6a11f8-7c7f-4ad4-8bf5-55f53ea997fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:49:03.469475 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 612/1230] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 13 23:49:03 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:49:13.455463 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=3 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:49:15.073632 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64215e-e4aa-4c68-9e86-fa0881dccd7d None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:49:15.092473 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64215e-e4aa-4c68-9e86-fa0881dccd7d None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:49:15.095994 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4782f5d-a0d6-442b-b6dc-861709009a31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05f1ce71ea7c4301ae0bfc84a06c9c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:49:15.096630 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4782f5d-a0d6-442b-b6dc-861709009a31 service neutron] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:49:15.096949 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4782f5d-a0d6-442b-b6dc-861709009a31 service neutron] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:49:15.097228 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4782f5d-a0d6-442b-b6dc-861709009a31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:49:15.106123 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4782f5d-a0d6-442b-b6dc-861709009a31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:49:15.107537 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4782f5d-a0d6-442b-b6dc-861709009a31 service neutron] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:49:15.116647 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 619/1231] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:49:15 2022] GET /identity/v3/auth/tokens => generated 2871 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:49:25.112650 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=10 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:50:22.935809 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a11f8-7c7f-4ad4-8bf5-55f53ea997fb None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:50:22.963668 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a11f8-7c7f-4ad4-8bf5-55f53ea997fb None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:50:22.968617 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036ac23-24d0-45f8-8dff-4ff4f5280785 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fbb147d802e48a082c7d928714f1dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:50:22.969305 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036ac23-24d0-45f8-8dff-4ff4f5280785 service placement] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:50:22.969598 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036ac23-24d0-45f8-8dff-4ff4f5280785 service placement] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:50:22.969880 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036ac23-24d0-45f8-8dff-4ff4f5280785 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:50:22.978889 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0036ac23-24d0-45f8-8dff-4ff4f5280785 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:50:22.980480 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0036ac23-24d0-45f8-8dff-4ff4f5280785 service placement] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:50:22.990951 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 613/1232] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:50:22 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:50:32.986054 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=10 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:50:44.272628 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2741cf-8710-4e05-bde0-1fcb98632076 None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:50:44.273149 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2741cf-8710-4e05-bde0-1fcb98632076 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:50:44.273237 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2741cf-8710-4e05-bde0-1fcb98632076 None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:50:44.274631 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 620/1233] 10.222.0.16 () {54 vars in 921 bytes} [Wed Jul 13 23:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:50:44.281133 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db300e94-d609-4037-ab9a-6310bc6d5289 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:50:44.281589 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db300e94-d609-4037-ab9a-6310bc6d5289 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:50:44.281670 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db300e94-d609-4037-ab9a-6310bc6d5289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:50:44.331185 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-db300e94-d609-4037-ab9a-6310bc6d5289 None None] MFA Rules not processed for user `a7e276c4bd434c028274e059a73c4060`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:50:44.332152 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-db300e94-d609-4037-ab9a-6310bc6d5289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:50:44.352405 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 614/1234] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Jul 13 23:50:44 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:50:44.364318 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2741cf-8710-4e05-bde0-1fcb98632076 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:50:44.378167 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2741cf-8710-4e05-bde0-1fcb98632076 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:50:44.383351 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6bad7e-1889-4f2d-8229-c7fedbdb0434 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e276c4bd434c028274e059a73c4060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:50:44.384103 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6bad7e-1889-4f2d-8229-c7fedbdb0434 service nova] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:50:44.384453 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6bad7e-1889-4f2d-8229-c7fedbdb0434 service nova] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:50:44.384801 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6bad7e-1889-4f2d-8229-c7fedbdb0434 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:50:44.399803 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6bad7e-1889-4f2d-8229-c7fedbdb0434 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:50:44.401530 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6bad7e-1889-4f2d-8229-c7fedbdb0434 service nova] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:50:44.419311 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 621/1235] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:50:44 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:50:54.349231 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=17 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:50:54.414426 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=6 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:50:58.099883 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694e27c-807e-460e-ab0f-f2c6e2f58f55 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:50:58.100415 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694e27c-807e-460e-ab0f-f2c6e2f58f55 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:50:58.100513 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694e27c-807e-460e-ab0f-f2c6e2f58f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:50:58.118280 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-d694e27c-807e-460e-ab0f-f2c6e2f58f55 None None] MFA Rules not processed for user `17ada9eb0ec7413599ebeeffd2ab9cde`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:50:58.119455 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-d694e27c-807e-460e-ab0f-f2c6e2f58f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:50:58.126078 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 615/1236] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 13 23:50:58 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:50:58.383995 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729eaf74-b06a-4870-a5c9-41c3942a072c None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:50:58.384488 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729eaf74-b06a-4870-a5c9-41c3942a072c None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:50:58.384584 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729eaf74-b06a-4870-a5c9-41c3942a072c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:50:58.419750 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-729eaf74-b06a-4870-a5c9-41c3942a072c None None] MFA Rules not processed for user `05f1ce71ea7c4301ae0bfc84a06c9c38`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:50:58.420888 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-729eaf74-b06a-4870-a5c9-41c3942a072c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:50:58.427720 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 622/1237] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Jul 13 23:50:58 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:50:58.438932 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d694e27c-807e-460e-ab0f-f2c6e2f58f55 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:50:58.452330 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d694e27c-807e-460e-ab0f-f2c6e2f58f55 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:50:58.456227 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033acc8-31d1-4da1-96a7-d7ce70d690d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05f1ce71ea7c4301ae0bfc84a06c9c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:50:58.456901 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033acc8-31d1-4da1-96a7-d7ce70d690d4 service neutron] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:50:58.457187 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033acc8-31d1-4da1-96a7-d7ce70d690d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:50:58.457465 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033acc8-31d1-4da1-96a7-d7ce70d690d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:50:58.464672 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a033acc8-31d1-4da1-96a7-d7ce70d690d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:50:58.466141 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a033acc8-31d1-4da1-96a7-d7ce70d690d4 service neutron] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:50:58.474427 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 616/1238] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:50:58 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:51:08.417498 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=9 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:51:08.471161 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=9 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:51:23.100433 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729eaf74-b06a-4870-a5c9-41c3942a072c None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:51:23.112732 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729eaf74-b06a-4870-a5c9-41c3942a072c None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:51:23.118880 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45496995-ad8a-45df-8011-35928d14e9a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05f1ce71ea7c4301ae0bfc84a06c9c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:51:23.119469 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45496995-ad8a-45df-8011-35928d14e9a9 service neutron] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:51:23.119930 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45496995-ad8a-45df-8011-35928d14e9a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:51:23.120211 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45496995-ad8a-45df-8011-35928d14e9a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:51:23.131229 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45496995-ad8a-45df-8011-35928d14e9a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:51:23.132788 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45496995-ad8a-45df-8011-35928d14e9a9 service neutron] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:51:23.146591 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 623/1239] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:51:23 2022] GET /identity/v3/auth/tokens => generated 2810 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:51:23.842323 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033acc8-31d1-4da1-96a7-d7ce70d690d4 service neutron] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:51:23.858230 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033acc8-31d1-4da1-96a7-d7ce70d690d4 service neutron] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:51:23.865997 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b491b6-a422-411c-974f-5acc6d27d7f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e276c4bd434c028274e059a73c4060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:51:23.866677 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b491b6-a422-411c-974f-5acc6d27d7f4 service nova] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:51:23.866967 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b491b6-a422-411c-974f-5acc6d27d7f4 service nova] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:51:23.867252 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b491b6-a422-411c-974f-5acc6d27d7f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:51:23.879362 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b491b6-a422-411c-974f-5acc6d27d7f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:51:23.881217 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b491b6-a422-411c-974f-5acc6d27d7f4 service nova] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:51:23.892872 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 617/1240] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:51:23 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:51:29.232600 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c0fc6-a925-4519-ad72-5b6ddeb5808d None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:51:29.233114 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c0fc6-a925-4519-ad72-5b6ddeb5808d None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:51:29.233224 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c0fc6-a925-4519-ad72-5b6ddeb5808d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:51:29.251077 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-b53c0fc6-a925-4519-ad72-5b6ddeb5808d None None] MFA Rules not processed for user `aa203abc047443588d0dd6867f25ecc0`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:51:29.252323 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-b53c0fc6-a925-4519-ad72-5b6ddeb5808d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:51:29.259762 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 624/1241] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 13 23:51:29 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:51:32.235065 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b491b6-a422-411c-974f-5acc6d27d7f4 service nova] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:51:32.244863 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b491b6-a422-411c-974f-5acc6d27d7f4 service nova] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:51:32.248886 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6611e-00e8-4770-b821-9406f3a6c62a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05f1ce71ea7c4301ae0bfc84a06c9c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:51:32.249932 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6611e-00e8-4770-b821-9406f3a6c62a service neutron] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:51:32.250447 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6611e-00e8-4770-b821-9406f3a6c62a service neutron] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:51:32.252177 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6611e-00e8-4770-b821-9406f3a6c62a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:51:32.263517 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c6611e-00e8-4770-b821-9406f3a6c62a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:51:32.265179 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c6611e-00e8-4770-b821-9406f3a6c62a service neutron] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:51:32.283199 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 618/1242] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:51:32 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:51:33.559738 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c0fc6-a925-4519-ad72-5b6ddeb5808d None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:51:33.569730 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c0fc6-a925-4519-ad72-5b6ddeb5808d None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:51:33.573254 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278dfb7-b3bd-44ab-a04c-29b2436d71ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05f1ce71ea7c4301ae0bfc84a06c9c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:51:33.573885 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278dfb7-b3bd-44ab-a04c-29b2436d71ee service neutron] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:51:33.574170 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278dfb7-b3bd-44ab-a04c-29b2436d71ee service neutron] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:51:33.574450 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278dfb7-b3bd-44ab-a04c-29b2436d71ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:51:33.584414 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278dfb7-b3bd-44ab-a04c-29b2436d71ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:51:33.585867 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278dfb7-b3bd-44ab-a04c-29b2436d71ee service neutron] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:51:33.595849 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 625/1243] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:51:33 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:51:42.274879 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=12 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:51:43.591351 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=15 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:51:57.052978 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6611e-00e8-4770-b821-9406f3a6c62a service neutron] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:51:57.061286 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6611e-00e8-4770-b821-9406f3a6c62a service neutron] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:51:57.065906 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534030b-16ce-4025-bb04-2e9476df0314 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05f1ce71ea7c4301ae0bfc84a06c9c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:51:57.066548 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534030b-16ce-4025-bb04-2e9476df0314 service neutron] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:51:57.066831 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534030b-16ce-4025-bb04-2e9476df0314 service neutron] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:51:57.067106 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534030b-16ce-4025-bb04-2e9476df0314 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:51:57.074640 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1534030b-16ce-4025-bb04-2e9476df0314 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:51:57.076071 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1534030b-16ce-4025-bb04-2e9476df0314 service neutron] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:51:57.084523 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 619/1244] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:51:57 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:52:07.081142 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=6 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:52:48.194498 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278dfb7-b3bd-44ab-a04c-29b2436d71ee service neutron] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:52:48.211407 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278dfb7-b3bd-44ab-a04c-29b2436d71ee service neutron] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:52:48.221231 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be493b-2544-4906-8740-cc230c712f72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e276c4bd434c028274e059a73c4060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:52:48.222224 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be493b-2544-4906-8740-cc230c712f72 service nova] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:52:48.237090 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be493b-2544-4906-8740-cc230c712f72 service nova] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:52:48.237629 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be493b-2544-4906-8740-cc230c712f72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:52:48.249125 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be493b-2544-4906-8740-cc230c712f72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:52:48.254585 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be493b-2544-4906-8740-cc230c712f72 service nova] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:52:48.269734 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 626/1245] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:52:48 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:52:55.953625 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534030b-16ce-4025-bb04-2e9476df0314 service neutron] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:52:55.963708 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534030b-16ce-4025-bb04-2e9476df0314 service neutron] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:52:55.968002 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107517a-e725-40bf-ac30-26aefb25c0d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05f1ce71ea7c4301ae0bfc84a06c9c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:52:55.969516 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107517a-e725-40bf-ac30-26aefb25c0d5 service neutron] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:52:55.969863 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107517a-e725-40bf-ac30-26aefb25c0d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:52:55.970139 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107517a-e725-40bf-ac30-26aefb25c0d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:52:56.035927 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f107517a-e725-40bf-ac30-26aefb25c0d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:52:56.037423 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f107517a-e725-40bf-ac30-26aefb25c0d5 service neutron] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:52:56.057204 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 620/1246] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:52:55 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:52:58.261679 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=6 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:52:59.178939 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a8086-f0d4-4a9e-aed4-f361ae62319a None None] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:52:59.179425 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a8086-f0d4-4a9e-aed4-f361ae62319a None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:52:59.179801 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a8086-f0d4-4a9e-aed4-f361ae62319a None None] PATH_INFO: `/` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:52:59.181340 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 627/1247] 10.222.0.16 () {54 vars in 921 bytes} [Wed Jul 13 23:52:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:52:59.198430 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42285f6-3eb9-48d4-99f9-53aa75395943 None None] REQUEST_METHOD: `POST` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:52:59.198868 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42285f6-3eb9-48d4-99f9-53aa75395943 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:52:59.199126 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42285f6-3eb9-48d4-99f9-53aa75395943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:52:59.250597 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.auth.core [None req-f42285f6-3eb9-48d4-99f9-53aa75395943 None None] MFA Rules not processed for user `4fbb147d802e48a082c7d928714f1dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=98936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:52:59.251834 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-f42285f6-3eb9-48d4-99f9-53aa75395943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:52:59.261458 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 621/1248] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Jul 13 23:52:59 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:52:59.274305 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a8086-f0d4-4a9e-aed4-f361ae62319a None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:52:59.288701 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a8086-f0d4-4a9e-aed4-f361ae62319a None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:52:59.293708 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3271467b-a6e8-4a02-98b8-ffe2ebe0fff7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fbb147d802e48a082c7d928714f1dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:52:59.294365 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271467b-a6e8-4a02-98b8-ffe2ebe0fff7 service placement] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:52:59.294653 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271467b-a6e8-4a02-98b8-ffe2ebe0fff7 service placement] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:52:59.294931 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271467b-a6e8-4a02-98b8-ffe2ebe0fff7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:52:59.304621 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3271467b-a6e8-4a02-98b8-ffe2ebe0fff7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:52:59.306269 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3271467b-a6e8-4a02-98b8-ffe2ebe0fff7 service placement] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:52:59.317298 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 628/1249] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:52:59 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:53:02.398587 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393fb29-9729-400d-a8f0-acaea7dc8931 None None] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:53:02.399080 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393fb29-9729-400d-a8f0-acaea7dc8931 None None] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:53:02.399270 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393fb29-9729-400d-a8f0-acaea7dc8931 None None] PATH_INFO: `/` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:53:02.400731 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 622/1250] 10.222.0.16 () {54 vars in 921 bytes} [Wed Jul 13 23:53:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 23:53:02.407239 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb60ad-4522-4dca-bd45-2e52804697af None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:53:02.407712 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb60ad-4522-4dca-bd45-2e52804697af None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:53:02.407929 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb60ad-4522-4dca-bd45-2e52804697af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:53:02.426226 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-23bb60ad-4522-4dca-bd45-2e52804697af None None] MFA Rules not processed for user `4fbb147d802e48a082c7d928714f1dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:53:02.427443 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-23bb60ad-4522-4dca-bd45-2e52804697af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:53:02.436320 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 629/1251] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Jul 13 23:53:02 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:53:02.447042 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6393fb29-9729-400d-a8f0-acaea7dc8931 None None] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:53:02.461543 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6393fb29-9729-400d-a8f0-acaea7dc8931 None None] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:53:02.467806 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230325b-b054-4575-9bee-daaf7d4de083 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fbb147d802e48a082c7d928714f1dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:53:02.469091 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230325b-b054-4575-9bee-daaf7d4de083 service placement] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:53:02.469530 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230325b-b054-4575-9bee-daaf7d4de083 service placement] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:53:02.469874 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230325b-b054-4575-9bee-daaf7d4de083 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:53:02.472125 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb60ad-4522-4dca-bd45-2e52804697af None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:53:02.480067 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c230325b-b054-4575-9bee-daaf7d4de083 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:53:02.481865 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c230325b-b054-4575-9bee-daaf7d4de083 service placement] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:53:02.484947 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb60ad-4522-4dca-bd45-2e52804697af None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:53:02.490163 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3ff1c-c9c5-40ff-90d7-002552437f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c258143da34685aa94a405e9ab3d07', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:53:02.491101 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3ff1c-c9c5-40ff-90d7-002552437f67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:53:02.491449 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3ff1c-c9c5-40ff-90d7-002552437f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:53:02.491810 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3ff1c-c9c5-40ff-90d7-002552437f67 admin admin] PATH_INFO: `/v3/users/17ada9eb0ec7413599ebeeffd2ab9cde` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:53:02.492946 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 623/1252] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:53:02 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:53:02.493132 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b3ff1c-c9c5-40ff-90d7-002552437f67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17ada9eb0ec7413599ebeeffd2ab9cde)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:53:02.495042 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b3ff1c-c9c5-40ff-90d7-002552437f67 admin admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:53:02.551535 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [None req-53b3ff1c-c9c5-40ff-90d7-002552437f67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17ada9eb0ec7413599ebeeffd2ab9cde'} {{(pid=98935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:53:02.558892 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [None req-53b3ff1c-c9c5-40ff-90d7-002552437f67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17ada9eb0ec7413599ebeeffd2ab9cde'} {{(pid=98935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:53:02.559594 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [None req-53b3ff1c-c9c5-40ff-90d7-002552437f67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17ada9eb0ec7413599ebeeffd2ab9cde'} {{(pid=98935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:53:02.571656 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [None req-53b3ff1c-c9c5-40ff-90d7-002552437f67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17ada9eb0ec7413599ebeeffd2ab9cde'} {{(pid=98935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:53:02.572299 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [None req-53b3ff1c-c9c5-40ff-90d7-002552437f67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17ada9eb0ec7413599ebeeffd2ab9cde'} {{(pid=98935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:53:02.584708 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 630/1253] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 13 23:53:02 2022] DELETE /identity/v3/users/17ada9eb0ec7413599ebeeffd2ab9cde => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 23:53:02.766980 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230325b-b054-4575-9bee-daaf7d4de083 service placement] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:53:02.784696 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230325b-b054-4575-9bee-daaf7d4de083 service placement] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:53:02.841525 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097e9ac-7fb9-46c4-948e-4a00528cd30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c258143da34685aa94a405e9ab3d07', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:53:02.842378 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097e9ac-7fb9-46c4-948e-4a00528cd30f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:53:02.842662 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097e9ac-7fb9-46c4-948e-4a00528cd30f admin admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:53:02.843443 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097e9ac-7fb9-46c4-948e-4a00528cd30f admin admin] PATH_INFO: `/v3/projects/060823b0a7404c55b661696da28762db` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:53:02.844914 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097e9ac-7fb9-46c4-948e-4a00528cd30f admin admin] RBAC: Authorizing `identity:delete_project(project_id=060823b0a7404c55b661696da28762db)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:53:02.846798 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097e9ac-7fb9-46c4-948e-4a00528cd30f admin admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:53:02.888453 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:53:02.893532 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [None req-a097e9ac-7fb9-46c4-948e-4a00528cd30f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '060823b0a7404c55b661696da28762db', 'request_id': 'req-a097e9ac-7fb9-46c4-948e-4a00528cd30f'} {{(pid=98936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:53:02.900049 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [None req-a097e9ac-7fb9-46c4-948e-4a00528cd30f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '060823b0a7404c55b661696da28762db', 'request_id': 'req-a097e9ac-7fb9-46c4-948e-4a00528cd30f'} {{(pid=98936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:53:02.905464 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [None req-a097e9ac-7fb9-46c4-948e-4a00528cd30f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '060823b0a7404c55b661696da28762db', 'request_id': 'req-a097e9ac-7fb9-46c4-948e-4a00528cd30f'} {{(pid=98936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:53:02.917697 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [None req-a097e9ac-7fb9-46c4-948e-4a00528cd30f admin admin] The token cache is being invalidate because project 060823b0a7404c55b661696da28762db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 23:53:02.917983 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [None req-a097e9ac-7fb9-46c4-948e-4a00528cd30f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:53:02.918597 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [None req-a097e9ac-7fb9-46c4-948e-4a00528cd30f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:53:02.920134 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 624/1254] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 13 23:53:02 2022] DELETE /identity/v3/projects/060823b0a7404c55b661696da28762db => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 23:53:02.925221 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3ff1c-c9c5-40ff-90d7-002552437f67 admin admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:53:02.926629 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-53b3ff1c-c9c5-40ff-90d7-002552437f67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:53:02.939372 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3ff1c-c9c5-40ff-90d7-002552437f67 admin admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:53:02.994353 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe8bdd-4d57-4c05-8647-62beca1b5440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c258143da34685aa94a405e9ab3d07', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:53:02.995243 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe8bdd-4d57-4c05-8647-62beca1b5440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:53:02.995545 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe8bdd-4d57-4c05-8647-62beca1b5440 admin admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:53:02.995814 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe8bdd-4d57-4c05-8647-62beca1b5440 admin admin] PATH_INFO: `/v3/users/112e772304cf44f5966336e9cc4370f9` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:53:02.997014 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abe8bdd-4d57-4c05-8647-62beca1b5440 admin admin] RBAC: Authorizing `identity:delete_user(user_id=112e772304cf44f5966336e9cc4370f9)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:53:02.998920 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abe8bdd-4d57-4c05-8647-62beca1b5440 admin admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:53:03.043195 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [None req-2abe8bdd-4d57-4c05-8647-62beca1b5440 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '112e772304cf44f5966336e9cc4370f9'} {{(pid=98935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:53:03.048650 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:53:03.050592 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [None req-2abe8bdd-4d57-4c05-8647-62beca1b5440 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '112e772304cf44f5966336e9cc4370f9'} {{(pid=98935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:53:03.051503 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [None req-2abe8bdd-4d57-4c05-8647-62beca1b5440 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '112e772304cf44f5966336e9cc4370f9'} {{(pid=98935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:53:03.064806 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [None req-2abe8bdd-4d57-4c05-8647-62beca1b5440 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '112e772304cf44f5966336e9cc4370f9'} {{(pid=98935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:53:03.065492 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [None req-2abe8bdd-4d57-4c05-8647-62beca1b5440 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '112e772304cf44f5966336e9cc4370f9'} {{(pid=98935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:53:03.078330 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 631/1255] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 13 23:53:02 2022] DELETE /identity/v3/users/112e772304cf44f5966336e9cc4370f9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 23:53:03.255735 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097e9ac-7fb9-46c4-948e-4a00528cd30f admin admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:53:03.257306 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-a097e9ac-7fb9-46c4-948e-4a00528cd30f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:53:03.272590 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097e9ac-7fb9-46c4-948e-4a00528cd30f admin admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:53:03.329418 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a7552-7679-4c19-95b2-ffa311736531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c258143da34685aa94a405e9ab3d07', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:53:03.330277 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a7552-7679-4c19-95b2-ffa311736531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:53:03.330563 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a7552-7679-4c19-95b2-ffa311736531 admin admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:53:03.330839 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a7552-7679-4c19-95b2-ffa311736531 admin admin] PATH_INFO: `/v3/projects/335131f0c252439298de8e1b4d1a7997` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:53:03.332005 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a7552-7679-4c19-95b2-ffa311736531 admin admin] RBAC: Authorizing `identity:delete_project(project_id=335131f0c252439298de8e1b4d1a7997)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:53:03.333960 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a7552-7679-4c19-95b2-ffa311736531 admin admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:53:03.379923 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [None req-4d7a7552-7679-4c19-95b2-ffa311736531 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '335131f0c252439298de8e1b4d1a7997', 'request_id': 'req-4d7a7552-7679-4c19-95b2-ffa311736531'} {{(pid=98936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:53:03.385921 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [None req-4d7a7552-7679-4c19-95b2-ffa311736531 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '335131f0c252439298de8e1b4d1a7997', 'request_id': 'req-4d7a7552-7679-4c19-95b2-ffa311736531'} {{(pid=98936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:53:03.392252 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [None req-4d7a7552-7679-4c19-95b2-ffa311736531 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '335131f0c252439298de8e1b4d1a7997', 'request_id': 'req-4d7a7552-7679-4c19-95b2-ffa311736531'} {{(pid=98936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:53:03.403293 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [None req-4d7a7552-7679-4c19-95b2-ffa311736531 admin admin] The token cache is being invalidate because project 335131f0c252439298de8e1b4d1a7997 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 23:53:03.403870 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [None req-4d7a7552-7679-4c19-95b2-ffa311736531 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:53:03.404214 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [None req-4d7a7552-7679-4c19-95b2-ffa311736531 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:53:03.405938 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 625/1256] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 13 23:53:03 2022] DELETE /identity/v3/projects/335131f0c252439298de8e1b4d1a7997 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 23:53:13.074454 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=9,keystone:DELETE=3,keystone:INSERT=1 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:53:13.400291 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=59,keystone:DELETE=11,keystone:INSERT=2 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:53:38.203862 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58a75c-76d9-4361-859f-d6aac77f4134 None None] REQUEST_METHOD: `POST` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:53:38.204538 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58a75c-76d9-4361-859f-d6aac77f4134 None None] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:53:38.204538 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58a75c-76d9-4361-859f-d6aac77f4134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:53:38.222124 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.auth.core [None req-9b58a75c-76d9-4361-859f-d6aac77f4134 None None] MFA Rules not processed for user `aa203abc047443588d0dd6867f25ecc0`. Rule list: `[]` (Enabled: `True`). {{(pid=98935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 23:53:38.223302 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-9b58a75c-76d9-4361-859f-d6aac77f4134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:53:38.277740 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 632/1257] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 13 23:53:38 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 23:53:38.586066 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a7552-7679-4c19-95b2-ffa311736531 admin admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:53:38.587540 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-4d7a7552-7679-4c19-95b2-ffa311736531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:53:38.645773 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a7552-7679-4c19-95b2-ffa311736531 admin admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:53:38.649334 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f5e26-97db-4623-a193-2f74de5b28e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05f1ce71ea7c4301ae0bfc84a06c9c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:53:38.650003 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f5e26-97db-4623-a193-2f74de5b28e0 service neutron] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:53:38.650288 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f5e26-97db-4623-a193-2f74de5b28e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:53:38.650568 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f5e26-97db-4623-a193-2f74de5b28e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:53:38.652306 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-358f5e26-97db-4623-a193-2f74de5b28e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:53:38.661749 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f5e26-97db-4623-a193-2f74de5b28e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:53:38.663182 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f5e26-97db-4623-a193-2f74de5b28e0 service neutron] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:53:38.671236 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 626/1258] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:53:38 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:53:39.104107 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58a75c-76d9-4361-859f-d6aac77f4134 None None] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:53:39.105534 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-9b58a75c-76d9-4361-859f-d6aac77f4134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:53:39.175028 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58a75c-76d9-4361-859f-d6aac77f4134 None None] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:53:39.179978 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03b49c-45bc-4cb7-88a5-adabe6770ca6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fbb147d802e48a082c7d928714f1dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:53:39.180620 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03b49c-45bc-4cb7-88a5-adabe6770ca6 service placement] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:53:39.180931 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03b49c-45bc-4cb7-88a5-adabe6770ca6 service placement] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:53:39.181206 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03b49c-45bc-4cb7-88a5-adabe6770ca6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:53:39.182926 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-fc03b49c-45bc-4cb7-88a5-adabe6770ca6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:53:39.194433 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc03b49c-45bc-4cb7-88a5-adabe6770ca6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:53:39.195995 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc03b49c-45bc-4cb7-88a5-adabe6770ca6 service placement] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:53:39.206031 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 633/1259] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:53:39 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:53:47.838952 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f5e26-97db-4623-a193-2f74de5b28e0 service neutron] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:53:47.840391 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-358f5e26-97db-4623-a193-2f74de5b28e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:53:47.909973 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f5e26-97db-4623-a193-2f74de5b28e0 service neutron] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:53:47.914969 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf5c09c-a4f6-44be-83a9-670bd6075c13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e276c4bd434c028274e059a73c4060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:53:47.915613 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5c09c-a4f6-44be-83a9-670bd6075c13 service nova] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:53:47.915899 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5c09c-a4f6-44be-83a9-670bd6075c13 service nova] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:53:47.916176 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5c09c-a4f6-44be-83a9-670bd6075c13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:53:47.917970 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-8cf5c09c-a4f6-44be-83a9-670bd6075c13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:53:47.930011 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf5c09c-a4f6-44be-83a9-670bd6075c13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:53:47.931696 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf5c09c-a4f6-44be-83a9-670bd6075c13 service nova] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:53:47.941593 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 627/1260] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:53:47 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:53:49.201464 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=57 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:53:57.937310 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=58 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:55:28.175944 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03b49c-45bc-4cb7-88a5-adabe6770ca6 service placement] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:55:28.177348 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-fc03b49c-45bc-4cb7-88a5-adabe6770ca6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:55:28.239484 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03b49c-45bc-4cb7-88a5-adabe6770ca6 service placement] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:55:28.244391 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b9bd3-f903-433e-96e5-db76f1359f37 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fbb147d802e48a082c7d928714f1dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:55:28.245051 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b9bd3-f903-433e-96e5-db76f1359f37 service placement] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:55:28.245338 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b9bd3-f903-433e-96e5-db76f1359f37 service placement] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:55:28.245617 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b9bd3-f903-433e-96e5-db76f1359f37 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:55:28.247334 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-1c4b9bd3-f903-433e-96e5-db76f1359f37 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:55:28.258751 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b9bd3-f903-433e-96e5-db76f1359f37 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:55:28.260310 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b9bd3-f903-433e-96e5-db76f1359f37 service placement] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:55:28.270056 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 634/1261] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:55:28 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:55:38.266128 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=28 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:55:45.079135 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf5c09c-a4f6-44be-83a9-670bd6075c13 service nova] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:55:45.124805 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf5c09c-a4f6-44be-83a9-670bd6075c13 service nova] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:55:45.130806 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c9bd1d-18ce-48a2-bb26-fbadbf823b09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e276c4bd434c028274e059a73c4060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:55:45.131649 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9bd1d-18ce-48a2-bb26-fbadbf823b09 service nova] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:55:45.131961 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9bd1d-18ce-48a2-bb26-fbadbf823b09 service nova] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:55:45.132562 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9bd1d-18ce-48a2-bb26-fbadbf823b09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:55:45.134565 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-20c9bd1d-18ce-48a2-bb26-fbadbf823b09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:55:45.148210 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c9bd1d-18ce-48a2-bb26-fbadbf823b09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:55:45.149879 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c9bd1d-18ce-48a2-bb26-fbadbf823b09 service nova] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:55:45.161096 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 628/1262] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:55:45 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:55:55.156357 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=20 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:56:23.930678 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b9bd3-f903-433e-96e5-db76f1359f37 service placement] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:56:23.940276 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b9bd3-f903-433e-96e5-db76f1359f37 service placement] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:56:23.943813 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb15b78f-532f-47b8-b7c2-c68a4b51bfbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05f1ce71ea7c4301ae0bfc84a06c9c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:56:23.944449 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15b78f-532f-47b8-b7c2-c68a4b51bfbc service neutron] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:56:23.944733 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15b78f-532f-47b8-b7c2-c68a4b51bfbc service neutron] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:56:23.945049 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15b78f-532f-47b8-b7c2-c68a4b51bfbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:56:23.946828 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-fb15b78f-532f-47b8-b7c2-c68a4b51bfbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:56:23.986033 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb15b78f-532f-47b8-b7c2-c68a4b51bfbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:56:23.987468 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb15b78f-532f-47b8-b7c2-c68a4b51bfbc service neutron] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:56:24.004989 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 635/1263] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:56:23 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:56:27.256346 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c9bd1d-18ce-48a2-bb26-fbadbf823b09 service nova] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:56:27.265511 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c9bd1d-18ce-48a2-bb26-fbadbf823b09 service nova] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:56:27.270346 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a543f33e-ba0b-4a82-b2bc-6d6e5626e772 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05f1ce71ea7c4301ae0bfc84a06c9c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:56:27.270987 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543f33e-ba0b-4a82-b2bc-6d6e5626e772 service neutron] REQUEST_METHOD: `GET` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:56:27.271271 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543f33e-ba0b-4a82-b2bc-6d6e5626e772 service neutron] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:56:27.271548 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543f33e-ba0b-4a82-b2bc-6d6e5626e772 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:56:27.273585 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-a543f33e-ba0b-4a82-b2bc-6d6e5626e772 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:56:27.356118 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a543f33e-ba0b-4a82-b2bc-6d6e5626e772 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:56:27.357511 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a543f33e-ba0b-4a82-b2bc-6d6e5626e772 service neutron] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:56:27.366848 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 629/1264] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 13 23:56:27 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 23:56:33.765032 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb15b78f-532f-47b8-b7c2-c68a4b51bfbc service neutron] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:56:33.766930 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-fb15b78f-532f-47b8-b7c2-c68a4b51bfbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:56:33.785360 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb15b78f-532f-47b8-b7c2-c68a4b51bfbc service neutron] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:56:33.790655 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11d482-f0e6-45ce-8f0d-2692c0bde65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c258143da34685aa94a405e9ab3d07', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:56:33.791549 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11d482-f0e6-45ce-8f0d-2692c0bde65b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:56:33.791833 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11d482-f0e6-45ce-8f0d-2692c0bde65b admin admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:56:33.792107 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11d482-f0e6-45ce-8f0d-2692c0bde65b admin admin] PATH_INFO: `/v3/users/aa203abc047443588d0dd6867f25ecc0` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:56:33.793394 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee11d482-f0e6-45ce-8f0d-2692c0bde65b admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa203abc047443588d0dd6867f25ecc0)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:56:33.795345 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee11d482-f0e6-45ce-8f0d-2692c0bde65b admin admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:56:33.852801 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [None req-ee11d482-f0e6-45ce-8f0d-2692c0bde65b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa203abc047443588d0dd6867f25ecc0'} {{(pid=98935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:56:33.860189 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [None req-ee11d482-f0e6-45ce-8f0d-2692c0bde65b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa203abc047443588d0dd6867f25ecc0'} {{(pid=98935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:56:33.861608 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [None req-ee11d482-f0e6-45ce-8f0d-2692c0bde65b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa203abc047443588d0dd6867f25ecc0'} {{(pid=98935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:56:33.874928 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [None req-ee11d482-f0e6-45ce-8f0d-2692c0bde65b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa203abc047443588d0dd6867f25ecc0'} {{(pid=98935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:56:33.875854 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [None req-ee11d482-f0e6-45ce-8f0d-2692c0bde65b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa203abc047443588d0dd6867f25ecc0'} {{(pid=98935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:56:33.890809 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 636/1265] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 13 23:56:33 2022] DELETE /identity/v3/users/aa203abc047443588d0dd6867f25ecc0 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 23:56:34.070223 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a543f33e-ba0b-4a82-b2bc-6d6e5626e772 service neutron] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:56:34.080488 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a543f33e-ba0b-4a82-b2bc-6d6e5626e772 service neutron] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:56:34.142454 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31714868-8e60-4e58-aae1-07b45d21c6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c258143da34685aa94a405e9ab3d07', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:56:34.143622 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31714868-8e60-4e58-aae1-07b45d21c6d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:56:34.143909 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31714868-8e60-4e58-aae1-07b45d21c6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:56:34.144186 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31714868-8e60-4e58-aae1-07b45d21c6d1 admin admin] PATH_INFO: `/v3/projects/c59955bf7cca41bf9f58e7fdfc2818e7` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:56:34.145453 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31714868-8e60-4e58-aae1-07b45d21c6d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c59955bf7cca41bf9f58e7fdfc2818e7)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:56:34.147363 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31714868-8e60-4e58-aae1-07b45d21c6d1 admin admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:56:34.193539 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [None req-31714868-8e60-4e58-aae1-07b45d21c6d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c59955bf7cca41bf9f58e7fdfc2818e7', 'request_id': 'req-31714868-8e60-4e58-aae1-07b45d21c6d1'} {{(pid=98936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:56:34.199444 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [None req-31714868-8e60-4e58-aae1-07b45d21c6d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c59955bf7cca41bf9f58e7fdfc2818e7', 'request_id': 'req-31714868-8e60-4e58-aae1-07b45d21c6d1'} {{(pid=98936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:56:34.205701 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [None req-31714868-8e60-4e58-aae1-07b45d21c6d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c59955bf7cca41bf9f58e7fdfc2818e7', 'request_id': 'req-31714868-8e60-4e58-aae1-07b45d21c6d1'} {{(pid=98936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:56:34.217393 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [None req-31714868-8e60-4e58-aae1-07b45d21c6d1 admin admin] The token cache is being invalidate because project c59955bf7cca41bf9f58e7fdfc2818e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 23:56:34.217755 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [None req-31714868-8e60-4e58-aae1-07b45d21c6d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:56:34.218385 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [None req-31714868-8e60-4e58-aae1-07b45d21c6d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:56:34.219989 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 630/1266] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 13 23:56:34 2022] DELETE /identity/v3/projects/c59955bf7cca41bf9f58e7fdfc2818e7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 23:56:34.224643 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11d482-f0e6-45ce-8f0d-2692c0bde65b admin admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:56:34.226144 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-ee11d482-f0e6-45ce-8f0d-2692c0bde65b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:56:34.243196 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11d482-f0e6-45ce-8f0d-2692c0bde65b admin admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:56:34.298724 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06792ffe-6922-41ab-ab6e-a09827fd1a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c258143da34685aa94a405e9ab3d07', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:56:34.299591 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06792ffe-6922-41ab-ab6e-a09827fd1a91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:56:34.299871 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06792ffe-6922-41ab-ab6e-a09827fd1a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:56:34.300138 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06792ffe-6922-41ab-ab6e-a09827fd1a91 admin admin] PATH_INFO: `/v3/users/8a8728ecd647445681cd829d615ed28c` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:56:34.312645 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06792ffe-6922-41ab-ab6e-a09827fd1a91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a8728ecd647445681cd829d615ed28c)` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:56:34.314740 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06792ffe-6922-41ab-ab6e-a09827fd1a91 admin admin] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:56:34.334963 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:56:34.361069 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [None req-06792ffe-6922-41ab-ab6e-a09827fd1a91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a8728ecd647445681cd829d615ed28c'} {{(pid=98935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:56:34.367850 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [None req-06792ffe-6922-41ab-ab6e-a09827fd1a91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a8728ecd647445681cd829d615ed28c'} {{(pid=98935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:56:34.368513 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [None req-06792ffe-6922-41ab-ab6e-a09827fd1a91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a8728ecd647445681cd829d615ed28c'} {{(pid=98935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:56:34.380396 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [None req-06792ffe-6922-41ab-ab6e-a09827fd1a91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a8728ecd647445681cd829d615ed28c'} {{(pid=98935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:56:34.381055 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.notifications [None req-06792ffe-6922-41ab-ab6e-a09827fd1a91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a8728ecd647445681cd829d615ed28c'} {{(pid=98935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:56:34.394056 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 637/1267] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 13 23:56:34 2022] DELETE /identity/v3/users/8a8728ecd647445681cd829d615ed28c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 23:56:34.562612 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31714868-8e60-4e58-aae1-07b45d21c6d1 admin admin] Authenticating user token {{(pid=98936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 23:56:34.564736 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.fernet_utils [None req-31714868-8e60-4e58-aae1-07b45d21c6d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 23:56:34.573850 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:56:34.578191 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31714868-8e60-4e58-aae1-07b45d21c6d1 admin admin] Validating token access rules against request {{(pid=98936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 23:56:34.635457 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a5e42-2984-44ae-8d8b-98728eaca050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4a30dab8dc6492bb2bda65abda06d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c258143da34685aa94a405e9ab3d07', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 23:56:34.636320 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a5e42-2984-44ae-8d8b-98728eaca050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 23:56:34.636600 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a5e42-2984-44ae-8d8b-98728eaca050 admin admin] SCRIPT_NAME: `/identity` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 23:56:34.636925 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a5e42-2984-44ae-8d8b-98728eaca050 admin admin] PATH_INFO: `/v3/projects/e5eff6225bce43c3877e3b22b0b68f07` {{(pid=98936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 23:56:34.648928 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a5e42-2984-44ae-8d8b-98728eaca050 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5eff6225bce43c3877e3b22b0b68f07)` {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 23:56:34.651063 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a5e42-2984-44ae-8d8b-98728eaca050 admin admin] RBAC: Authorization granted {{(pid=98936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 23:56:34.696399 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [None req-684a5e42-2984-44ae-8d8b-98728eaca050 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5eff6225bce43c3877e3b22b0b68f07', 'request_id': 'req-684a5e42-2984-44ae-8d8b-98728eaca050'} {{(pid=98936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:56:34.702882 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [None req-684a5e42-2984-44ae-8d8b-98728eaca050 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5eff6225bce43c3877e3b22b0b68f07', 'request_id': 'req-684a5e42-2984-44ae-8d8b-98728eaca050'} {{(pid=98936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:56:34.709551 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [None req-684a5e42-2984-44ae-8d8b-98728eaca050 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5eff6225bce43c3877e3b22b0b68f07', 'request_id': 'req-684a5e42-2984-44ae-8d8b-98728eaca050'} {{(pid=98936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:56:34.723190 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [None req-684a5e42-2984-44ae-8d8b-98728eaca050 admin admin] The token cache is being invalidate because project e5eff6225bce43c3877e3b22b0b68f07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 23:56:34.723479 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [None req-684a5e42-2984-44ae-8d8b-98728eaca050 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:56:34.724095 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG keystone.notifications [None req-684a5e42-2984-44ae-8d8b-98728eaca050 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 23:56:34.725745 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: [pid: 98936|app: 0|req: 631/1268] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 13 23:56:34 2022] DELETE /identity/v3/projects/e5eff6225bce43c3877e3b22b0b68f07 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 23:56:44.389757 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 23:56:44.720077 dv-osbrick-849759-3-ceph devstack@keystone.service[98936]: DEBUG dbcounter [-] [98936] Writing DB stats keystone:SELECT=53,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 00:00:33.300351 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06792ffe-6922-41ab-ab6e-a09827fd1a91 admin admin] Authenticating user token {{(pid=98935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 00:00:33.301823 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-06792ffe-6922-41ab-ab6e-a09827fd1a91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 00:00:33.380450 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06792ffe-6922-41ab-ab6e-a09827fd1a91 admin admin] Validating token access rules against request {{(pid=98935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 00:00:33.438650 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca9bfc-e903-464e-96d1-a4f091498862 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fbb147d802e48a082c7d928714f1dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b8489ad08d40bc8f19a6ffa01c6897', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 00:00:33.439293 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca9bfc-e903-464e-96d1-a4f091498862 service placement] REQUEST_METHOD: `GET` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 00:00:33.439573 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca9bfc-e903-464e-96d1-a4f091498862 service placement] SCRIPT_NAME: `/identity` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 00:00:33.439844 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca9bfc-e903-464e-96d1-a4f091498862 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 00:00:33.441594 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.fernet_utils [None req-77ca9bfc-e903-464e-96d1-a4f091498862 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 00:00:33.452185 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca9bfc-e903-464e-96d1-a4f091498862 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 00:00:33.453792 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca9bfc-e903-464e-96d1-a4f091498862 service placement] RBAC: Authorization granted {{(pid=98935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 00:00:33.463253 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: [pid: 98935|app: 0|req: 638/1269] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 00:00:33 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 00:00:43.459351 dv-osbrick-849759-3-ceph devstack@keystone.service[98935]: DEBUG dbcounter [-] [98935] Writing DB stats keystone:SELECT=62 {{(pid=98935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}